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PREFACE 



The development of a Career Education program has been 
a challenging and rewarding experience. Materials, guide- 
lines and advice provided by the United States Office of 
•Education, Regional Progr^n Officers and Dr. Kenneth Hoyt hf 
been invaluable to the project staff. 

A special thanks is in order for Dr. Frank G. Nelson, • 
Educational Management Corporation (Bend, Oregon). His 
exjierience and expertise in management practices and 
evaluation techniques, as well as his reporting skill, 
have provided the technical a£?sistance so vitally necessary 
for successful implementation. 
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A. 



TIME PERIOD COVERED 



July 1, 1973 through June 30, 1976 



B. GOALS AND RESULTS 



During the three ye.:^T history of the project the primary focus for 
project activities has been systematic development of components 
which would satisfy requirements for "transportability" and 
operational effectiveness. These processes were confounded, some- 
times significantly, by changing emphases of the project sponsor 
and the school district. 

A model to guide the total effort was conceptualized during the 
first year and revised as necessary during subsequent years. It 
has provided a means to plan continuing activities of the project 
and, at this point, may also serve as the basis for planning new 
career education programs. 

Perhaps the most difficult problem encountered has been identi- 
fication of those strategies which could have the greatest effect 
upon integration of a career education philosophy. This problem 
is the result of conflicting values, c3ose budgets and the general 
question of which emphases within a school district will prove 
most valuable for students. The problem is not idiosyncratic 
to this project. 

Despite this problem, the levrl of career awareness among the 
professional staff of the dls evict has been greatly enhanced by 
project activities. Evidence to support this conclusion was 
found in the .school district annual report, in curriculum chan^^es, 
in topics of conversation among staff, and in many other areas. 
This information is perhaps the most significant to emerge as it 
indicates that teachers are not only able to integrate career 
education concepts, but they are also willing to integrate such 
strategies. Historically, staff willingness to adopt new ideas 

P^Q^g^"^^^ ^^^^ the mos t sign-ificant constraint to diffu- 
sion of an innovation. " ™ 

Major developmental e^iphases of the project have been: 



1. Staff training; 

2. Curriculum revision and guides; 

3. Identii'ication, acquisition and distribution of appropriate 
instructional resources; 

4. Career Information Centers; 

5. Commtjnity Resource Center; and 

6. Coordination of services to provide for various forms of 



work 
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The^ typical problems encountered in treatment delineation within 
a "p ubT.iTr~^icKoo X^"^^^^ 
these classical shortcomings, several significant findings were 
observed. Achievements of the project in each. major goal area are 
summarized below: 

!• Student Outcomes ; Treatments which had a significant effect 
are listed below: 

a. Self- Awareness 

-Barclay Classroom Climate Inventory 
-D.A.T. Career Planning Program 

Work Awareness 

-Curriculum Infusion . 
—Community resources 
-Counselor intervention 

-Special test interpretatdon (such sl^ O.V.I.S.) 
-Use of Career Information Centers « 
-Cooperative Work Program ^ 
-Student maturation 

c. Career Decision-Making Competence 

-Special instructional units and courses 
-Work Experience Program 
-Various combinations of treatments 

2. . Placement : Important changes in the district placement program 
included additional supervisory staff, an increase in the 
number of placement options available to students, and changes 
in criteria used to provide students with work exploration 
opportxinities. This latter appears especially significant 
as the changes have been from criteria such as grades, atten- 
dance and completion of pre-requisite courses to criteria such 

J as -career goals, student interests , and availability of ^ — 

appropriate sites. 

Problems still to be resolved are the number of working students 
not enrolled in a school sponsored program and coordination of 
services available to students upon leaving high School. Ten- 
tative solutions, have been designed and will likely be implemented 
in .the near future, 

3. Counseling : The skill which cotmselors manifest ^n using data 
for making decisions was clearly evident in changes made in the 
career testing and counseling program. Several tt^-^ts were 
dropped, and others used more extensively ^ as data from evalua- 
tion processes clarified their usefulness* 
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The role of counselors in a career education program remains 
somewhat ambiguous* The problem appears to be related to 
history and traditions rather than counselor willingness or 
ability. This will b,e a difficult problem to resolve. 

Curriculum ; While changes in relation to this goal are the 
most difficult to measure » general observations would support 
the significance of project efforts. Most noticeable is 
the frequency cf career-relattd activities in annual reports 
and changes or modifications to curriculum guides, Thi3 
suggests that teachers ^ and others, have accepted the impor- 
tance of career education and are working toward full 
int<»gration of the concept. Given this willingness to 
implement the concept, continued work is a relatively simple 
natter of providing teachers with approprlsite information, 
materials, and training. 

Career Education Support ; The project staff participated in a 
broad ran:$e of activities which contributed to the overall 
effect of the project. These do not, generally, have a terminal 
point in the development effort, as emergent products will 
continually be revised, expanded or adapted to changing condi- 
tions within the district. 

Included among these types of activities were: 

a. Installation and use of Career Information Centers; 

b. Implementation of a Community Resource Center; 

c. Addition of courses to the curriculum 

d. Imp-rovements in th^ cooperative work and work experience 
programs ; 

c. Staff development; 

Model development; 

g. Strategies to facilitate student internalization of 
career concepts; and 

h. Studies of student career patterns. 
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A. DESCRIPTION OF THE PROJECT 



Program Overview 

History. In Jxily 1973f the Great Falls Public Schools were awarded 
a grant under Part D of the Vocational Education Act to design and 
implement an exemplary program in career education. The intent of 
this program has been to integrate the combined efforts of local 
people, staff from the- State University system, staff of the State 
Department of Education, and others, which would culminate In a 
demonstration program available fo observation and/or adaptation 
by school districts throughout thu State of Montana, 

One of the primary intents of the project has been to establish a 
• career awareness curriculum In the elementary an?! secondary schools 
that provides all students with a broad ranges qX options in the 
world of careers • The project has attejupted *o stimulate develop- 
ment of each student *s aspirations and to provig^ him or her with 
the ability to make wise career decisions when he or she is ready. 

The project was conceptualized as being comprehensive in nature 
and sweeping in scope. Because rf the charge to develop an ex- 
emplary program. It has addressed a variety of issues and develop- 
mental activities during its three-year history. 

The ProiAct'Servicft Ar^fla, The City of Great Falls is located imme- 
diately east of the Rocky Mountains and generally in the central 
portion of the state on a north-south axis. The 1970 census 
showed the cl^y to hfi^ve a population of 60,091 residents and the 
county a population of 8l,80^*. Located within the city are a di- 
verse range of iaajor industrial, transportation and service 
compani^i^s. These include the Anaconda Company, Montana Deaconess 
HoBpital, the Burlington Northern Railroad, Columbus Hospital^ 
Mountain Bell Telephone Company, and the Great Falls Tribune. 
Great Falls is also a center of government activity with over 
5,000 state and federal government employees working within the 
city. 

There are 78I retail business establishments located within the 
city of Great Falls. These firms employed (in 1971) 3,383 persons, 
with a total retail sales (in 1971) of over 176 million dollars. 
There are lk2 wholesale business activities In th*® city which em- 
ploy nearly 1,400 persons. Wholesale sales (in 19^1) exceeded 
195 million dollars. 

The Great Falls Public School system includes Sl^elementary schools, 
h junior high schools and 2 senior high schools. In 1975-76, the 
elementary schools (K-6) had a total enrollDeut of 8,3l6 students, 
juaiOI^-hi^h-»choale-^7-^^ 
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senior high schools (10-12) enrolled i*,36l students. , Included with 
in the public school system is a Vocational Technical School which 
em-olled 306 students during this academic year. 

The Great Falls Public School system has an excellent support capa- 
bility, as manifest in the number of specialists employed by the 
district. For example, elementary schools specialists are employed 
in such diverse areas as library, art, instrumental and vocal music 
physical education, and environmental education. General support 
for the district is manifest in capabilities such as school psy- 
chologists, physical education specialists and family counselors. 

Expected Outcomes . General classes of student oucomes expected 
as a result of project activities have included: 

1. Increased student awareness of the broad range of 
options in the world of careers; 

2. A reduction in school drop-outs; 

3* An increase in vocational guidance services; 

U. More realistic career choices bj students; 

5. Greater perceived relevance in th*i school curriculum; 

6. An increase in educational and job placement; and 

7. Total involvement by both teachers and administrators 
in career education. 

Structure *- ; organization 

Historically, career education has not existed is a discrete, 
mutually axclusive, entity. Rather it represents a philosophy - 
of education which should ultimately permeate the entire educa- 
tional structure of a given institution. Obviously, this factor 
poses special problems for a "project" devoted to the develop- 
ment of such a philosophy within a school district. It requires 
the support of all echelons of administration, instructional and 
support staff if the desired goal is to obtain. 

Because of the pervasivo nature of career education, it was neces- 
sary during the first yoar to develop a conceptual structure which 
would enable the project staff to identify specific tasks and to 
subsequently prioritize those tasks for effecient management of 
the project. The model developed for this p\irpose is shown in 
Figure 1. 



FIGURE 1 

CONCEPTUAL STRUCTURE OF THE PROJECT 




Level of Developnent 



This acxiel has served to concomitantly organize and integrate the 
primary foci of career education and development of operational 
programs. The three major dimensions shown are levels of develop- 
ment, areas of development and populations of concern. 

Additionally, ther^ has also existed an historical aabigtiity in 
the def irdtion of elements includad within the broader concept of 
career education. For example, confusion has existp'd ip^the defi- 
nitions of self-awareness, familiarization, program activities, 
outcome ar3as, treatments, work values, etc. Consequently, project 
staff traced these elements through the literature tod assigned 
specific definitions to each of the major concept ^elements* These 

elements, including a complete listing of treatments, are shown 
in outline form in Table 1. 

. -6- ^ 
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•Levels: 
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PROGRAM STRUCTURE 



Elementary 
JuniorHigh 
Senior High 




•Outcome Areas 



TABLE 1 



PROGRAM ELEMENTS 



A. Outcome Areas 

p. 

1- Self -Awareness 

2. Basic Skills 

3. Work Values 

4. Work Knowledge 

5. Career Decision-Making Skills 

6. Work Habits 

?• Work Seeking/Obtaining Skills 

8, Placement 

9» Continued Education 

B. Activities , 

1 . Famil iari za t i on 

2. Career Orientation 
3- Career Exploration 

Work Experience 
5" Placement 

C. Treatment 



1. Curriculum Infusion 

2. Field Trips 

3- Special Materials 

Resource Centers 

5- Counselor Activities 

6. Career Information Centers 

7» Placeiaent and Follow-up 

8. : D.U.S.O. 

9". Resource Persons 

10. B.C-C.I. • 

11. Library Study 

12. D.A.T./C.P.P. 

13. C.E.Q. 



Ih. ATS~6 (Satellite Technology) 

15* World of Construction 

16. C.E.E.B./Decision and Outcome 

17. O.V.I.S. & C.I.C. 

18. '.G.A.T.B. & I.C.L. ^ 

19. Career Math ^ 

20. Work Observation i 

21. Work Experience 

22. Vocational Education Courses 

23. Placement Procedures 
2U. Job Seeking Program 

25. Mllitar> Cluster 

26, Consumer Economics 
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3. Program Goals 



The conceptual structures and definition procedures employed 
during the early history of the project have proven useful to 
identify specific objectives and tasks to be completed. In this 
sense, they have also proven useful by improving management 
efficiency. 

General goals established during. the first year of the program 
'have been largely retained. , Thpy are: 

1. Placement; To develop, a program which facilitates 
satisfactory placement of students in either employ- 
ment, education or training which permits the pur- 
suit of a career choice or meets a real or perceived 
economic need. 

v:2. giirr i culum To facilitate integration of career educa- 
tion concepts into the curriculum such that each stu- 
.dent may systematically develop those skills that en~ 
able him or her to function in the defined life roles 
including, but not limited to, citizanship, family, 
economic, and avdcational. 

3. Sfflaiiafiliag: To develop and Implement procedures that 
enable stivients to explore and understand their unique 
characteristics and hov these characteristics relate 
to the defined life roles (citizenship, family, avo- 
cational, economic). 

^. Mana^gmgjat: To develop procedures for planning., or- 
ganizing, directing, and controlling staff, project, 
district^ and community resources to insure the adoption 
of project goals within the district and to facilitate 
transportability of the model. 

Operational definitions for these goals were manifest in sets of 
objectives derived from each. These objectives served to structure 
project activities including the generation of those data which 
^ would facilitate derivation of new objectives and revision of 
project operations. *^ 

The complete listing of specific objectives employed by the project 
is presented below: 

1. Placement 

1.1. To in;uure that each student has available to him 

or her those services 'whi<Ji can be used to Tacili- 



School 
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To' insure that each student has available to him 
or her those services and information which can 
be used to facilitate msJcing a decision concerning 
further education or training 

To provide a service to coordinate available job 
openings with various work programs and those 
students who desire part-time employment 

To identify and use resources t)f people, agencies, 
facilities, and materials located vdthin the 
comaiunity 

To design and implement a mechanism which coor- 
dinates utilization of community resources and 
maximizes their contribution to specified project 
needs 

.c. 

Curriculum 

2.1. To develop in each student positive attitudes 
toward career education concepts including the 
following constructs: 

' Personal significance of. productive work 
Social significance of productive work 
Family 
Avocational 
"Citizenship 
Ecohomi c 

2.2. To insure that each student develops the know- 
; ledge base and experiential,. repertoire that 

would enable him or her to make a satisfactory 
career choice upon completion of grade twelve 

2*3* • To insure that each student is aware of the 
broad raiige of career options open to him or 
her in the world of work 

2.4. To provide each student with the skills neces- 
sary to continually re-assess his or her career 
choice 

275 • Too insure that each student perceives his or 
her studies as relevant to career interests 

2,6; To insure that each student "is able to employ 
the career cluster concept as the unifying 

q l ggg ^ K Qf - 



1.2. 

1.3. 
l.k. 

1.5. 
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2.7. To insure that each student is able to parti- 
cipate in those school and/or community ex- 
periences which assist him or her in identi- 
fying and evaluating his or her .own interests, 
abilities and values 

2.8. To insure that each student iias the opportunity 
for detailed "exploration'^ of at least three 
cetreer clusters of his or her choice 

2.9. To insure that each student is provided with an 
opportunity for in-dcpth exploration of at 
least one career cluster 

2.10.,. Each student will be provided with t'he oppor- 
tunity for "specialized' preparation in a 
selected career cluster 

Counseling 

3.1. To insure that each student is able to., acquire 

self-awareness of innate and acquired abilities, 
preferences. and potentials 

'3-2. To insure that each student possesses the requi- 
site skills to relate acquired self -awareness to 
iLaking career decisions 

3.3» To insure that each student ha3 available to him 
or her information about defined roles (citizen- 
ship, family, avpcationai, and economic) 

3»^v To insure that each student has availabl^ to him 
or her the "coimsfellng sexTices necessary to make 
jrricular choices in scl\ool and educational and 
f Ckccupational choices when leaving school. 

3.5* To i^sign and -implement a mechanism which enables 
students to up-date, or revise, decisions made 
relatlNre to selection of cluster study activities 

Management n 

4.1. To effect close, continued involvement of private 
and parochial schools in all aspects of project, 
operations 

4.2. To insure comprehensive and useful evaluation of 
the project by selection and employment of a 

P,^9^jj^^9A.QYg^ : 

4.3. To integrate relevant^aspects of existing special 
programs into a career education curriculum 

-11-- 
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k.k. To maximize cooperatdor and coordination iDetween 
the project and the District Special Education 
Department / 

k.^. To define, for purposes of this project, studehts 
whose career education needs maj be classified as 
"special" 

^.6. To design and implement project components which 

will satisfy idiosyncractic needs of students with 
unique learning abilities, physical handicaps or 
emotional disorders 

^.7. To establish an Advisory Council which can assist 
the project in developing its use of community 
resources 

^.6, To define those roles for teachers, administrators 
and sp3Cialists which will best satisfy the goals 
of career education 

^.9. To employ a strategy of on-site visitation by key 
staff for purposes of effecting diffusion and 
integration of key career education elements 

^.10. To design and conduct necessary studies for pur- 
poses of identifying sikaff needs related to kr;ow- 
ledge of career education and integration of 
areer education concepts into the curriculum 

h.ll. To design and conduct .those in-service and/or 
graduate' college programs which will satisfy 
identified teacher needs in career education 
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B. MAJOR ACTIVITIES 



Introduction 

The original proposal under which this program was funded provided only 
a listing of fourteen elements which could be included in a career 
education program.. It did not outline a rationale for an "exemplary" 
program nor were procedures described which could be used to derive 
such criteria. 

Consequently, one of the. initial activities of the project staff was 
establishment of goals which '--.ore accurately described the desired 
outcomes from the development effort and which would ensure that speci- 
fied student outcomes would obtain. An included activity was identi- 
fication of existent policy, legal requirements and other, constraints 
to program development. 

Areas of concentration selected for project development were those 
named in the cpnceptual structure presented earlier. !Fhese were de- 
rived from a careful analysis of the intent of the original proposal, 
relevant policies of the school district and capabilities of district " 
and project staff. ' 

While it would be desirable to approach design, development and instal- 
;lation ofalnew program in a linear fashion, this is typically not possi- 
ble in the context of an operational school district. Instead, new 
programs must be treated as a limited synergism and, in accordance with 
general system theory, "the interaction between components of the new 
progra.*" and j the proposed operational setting must be systomatically 
addressed. I Consequently, when working in the definition phase, it was 
also necessary to^ address implementation. In the absence of such 
planning and definition, it is likely that teachers and athers would • 
be tinable or unwilling to use products -developed. 

To facilitajte the level of detail necessary in planning project, acti- 
vities, a project management worksheet was developed. This procedure, 
and associated documents, provided a means for the staff to identify 
included tasks in each project objective. and to subsequently order those' 
tasks to maximiSe development and implementation efficiency. An example 
of these worksheets is shown in Figiure 3. 



! 
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FIGURE 3 

EXAMPLES OF PROJECT MMIAGEMENT WORKSHEETS 



COA^ fe'JHBER: 1 (Pl.-^cnmant ) 



TPROJECT HANAGEHgNT WORkSHE^T'] 



f,^'"n'''^»^^'^^^^^^^^' "'^^ -ittifirnf h nn nv/r^U-'Mln to htm tfin-v/ -.rrv 1 cr-. rh cnn ii-.Grt tn rncllltntc 

JflUf^Deri^i ^ ; till finding nntlatnct : I'jn in omploywont upon leovlnQ . rjchnol . 

Subordinate Objective: Tn rr^lnn n ptiMlc rclntlon pronrnm to encotirn^o pnti.mtlnl emplnyem .md employment 

(Nunber: i ) aqonclon to hlru ittudcnts upon thair lonvlng tichool ,. I " 
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Seq- 
uence 
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Task Schcfiute 


r 
z 
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T 


Purpose 


Prcrrq. 
Tasks 


Respon. 
Person 


Hate 


/ 


/ 




Lorm i\ cijn'mltto'i on plncement to rovieui activities 
rnr recn'rmcriclntion 


ovur;m rilft!. 
to folloto 




' nrrnnt i nn .\\ 

iTftrmlttce V 


'Jnavnr ' 
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ContPCt Stnte Bmploympnt nervLce 


Inf orm thc" c 


r " 


k/laltatlon 





























. GOAl NUHBER ^ H ( Cnun j 1 1 np ) • 



Prifflrtry Objective; Tp |t^^>urp thit rncH ?tud?nt It; pble to ncouire self^auarenes*; oT Innnte »^nd qcqulret? pblU.tles, ' 
(Nupiber: 1 ) cionbllitlpu^ preforencea^ and potentials. ^ , ■ . 

Subordinate Objective: Co'inrrinra ulU ass ist In the developmont of pilot pronriwnn ualnn neui Instruments ancl/ftr 
(Number:. 2. ) tests. ' ~ — — ^ ^ ^. 



t^k ID 


Task" 
. Sejq- 
ue.xe 


Task' Oeicriptton 


Rationale* 


Criterion for 
Completion 


^ 'K' ik Schedule 
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A1 


If 


T' 


Pjrpcse • 


Prcreq. 
Tasks 


^y r;. ] 


Co«"p1 . 
Date' 












r\rrf*'-)r OCT !r p-ch H.S..:'bv selected studcn 


3 Oetqrminc 
ir.pf n1ng-.«: 












Counselors nnet with rporesentativr of teat^ conJi, 


To , lurj^est 

nOQSlhl n fcpnt 


t 




1 
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GOAL miHBER: I II (Hgn^n gmqnt) 



[PROJECT HANA CEHEN T WORkSHE£f 



Primary Objec1t!ve; Jo effrct clonn,. contlntiRd involvement of priva te and porochlnl schools In-oli aspects of prolect 
(Nimbe r : 1 ) oopratlonn . , ~ ' ^ —rr. -^7: ^— 7- 

..Subordinate Objective: orrnnng fpr Inclunlon pf stoff and, students of privata a nd perochlal schools In District 
(Nurber: 1 ) octiviTTisT — ^ — 7~ : ■ — 
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Seq- 
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Completion 


Task Schedule 
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Prcreq. 
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Respon. 
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Cotnp 1 . 
Date 
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Inclutir staff 'in flrlv. Council and spsclal .v 

cnn^ittcca. 
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explore conperntlvc planning at tast and L&C achoo. 
ul th 0 & B schppi 
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GOAi NUH8ER: y,, fmrMrulu^.) 



fTROJECT HANAGEHENT WORkStiEET I 

clvn nttltudm tOMirrt Hnrrpr tducntlnn cnncnpts. Inclurilnn: 



Pri-Ky Objective: Tn M'-vr Hp In pr^ctt ntuft< • .,>.w>.u.i.. I >.w»-..rn .^..r.rirr r.ouciwnn cnncnpx.^ . mcni 

{i\rOfr: \ ) pTr^onal nlo"l' Ic.-nci? ot productive work; oocisl filfjnificnnco of productive wnrk; and 

roloo In frmiiy, r t tlrnnnhln, nnrl econpmic nystnon.' 
Kher i ^ ) ''^ ' t^.^rnttpnnllv rtrfinp nttlCudinnl cnnnt ructs for men>iurcmcnt nurnn^n^,. 
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uence 
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'"rttlqun risflnltlonn dovaloport 
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Activities pursued thronighout the three-j^ar history of the project 
were generally consistent with the conceptml model. Major emphasis 
in each goal area, for each year of the project, are sunnarized below. 

1. Placement 

Year One^ A placement committee was organized which included 
representatives from the school service staff such as counselors, 
the academic disciplines and the business/labor/govemaent ccaimniixity. 
Included in this latter group were persons from the Montana 

Employment Security office, labor union representatives and staff 

^rom private pla cement "^agencres r " The ma j or emphasi s" in" c " ' 

work was development of procedures for job placement which satis- 
fied legal requirements and labor practices. Additionally, devel- 
opment of out-of-school learning experiences was initiated • 

Year Two. Early work by project staff had revealed that local 
placement services were sorely flacking in coordination of their 
services. The resulting confusion for young people appeared to 
have an inhibiting effect on placement success. Consenxzently, the 
primary objective became one of consolidating the effo. ta of 
various placement agencies. 

Plans were also developed in conjumcti^E vith high schot^l adminis- 
trators for a program in agribuisiness which would increfilse work 
experience opportunities within the cooperative programs and which 
would also include development of several important career skills • 

Year Three. Problems associated with lack of placement coordina- 
tion, and the resultant loss of placement effectiveness, were only 
partially resolved during tiio first two years of the projec t. During 
the final year of the project, an "awareness" program was initiated 
to obtain wider participation in efforts tx> resolve;the probleas. 
For example, one study revealed that over IfOO students were employed 
in various locations, but were not enrolled in any form of work 
program. In the absence of counseling and/or supervision, most of 
these students were working at jobs totally unrelated to their 
career goals or they had- not considered ^ork in relation to career 
goals. / 

The "afr^^reness" program was quite miccessful with many more 
pevBom - both school and community - becoming sensitive to tfta 
problem. Solution strategies have not yet been designed. 

2. Curriculum Development 

Year One . Cross-grade level and inter-disciplinary planning were 
initiated through regular meetings of the Secondary and Elementary 
Curriculum Committees and the graduate in-service program. District 
curriculum specialists were included as necessary and timely. 
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Year Tvo . At the . elenentary level, efforts were continued to iden- 
tify areas within the existing curriculum for logical insertion of 
Career education concepts* Emphasis was placed on adoption of a 
career-related basal reading program and improving career content 
of social science iinits. Also continued throughout the year was an 
evaluation program of both. print and non-print materieuLs. This 
latter was included within a larger program of materials identifi- 
cation and acquisition. Finally, a new kindergarten curriculum 
guide with an emphasis on self-awareness was piloted and revised 
for final publication. 

At -the secondary level, interested teachers were encouraged and 
assisted by project staff to incorporate elements of career educa- 
tion. A survey was conducted to determine the extent to which 
career education, concepts are manifest in the current curriculum. 
This study was used to determine areas in which developmental 
efforts would focus in the final year of the project. 

One of the most valuable activities coLipleted was development of 
a Community Resource Center for use at both elementary and second- 
ary levels. Teacher evaluation of the Commxmity Resource Center 
was overwhelmingly positive. 

Year Three . In keeping with the plan for program development, 
emphasis during the third year vas upon improving operational 
procedures, budgets^ and development of necessary policies to insti- 
tutionalize program products. Included product3 were the Community 
Resource Center; new curriculum guides; materials (media) identifi- 
cation, acquisition and distribution; staff development; and a 
career education philosophy for use in continued curriculum 
planning. 

Counseling ' 

Year One . Major activities centered upon identification of coun- 
seling service requirements at the elementary level, improvement 
of career guidance at the secondary level and determination of 
necessary action to reduce the niimbers of students who dropped out 
of school.' A secondary effort initiated was aimed at determination 
of the most appropriate career-counseling role for school coun- 
selors. This included an examination of present services, coun- 
selor perceptions of their role in placement and determination of 
necessary data bases. 

Year Two . Career guidance services at the secondary level were 
* improved through new approaches to test interpretation, use of 
specially trained staff in the Career Information Centers and 
closer interaction between counselors and other district staff. 
A change in scheduling procedures also contributed to better use 
of counselor time. 
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Year Three , During the final year of the project several nev 
testing and counseling strategies vere iapleinented. Each was based 
upon the vork and findings of the preceding two years.v.' For exam- 
ple, earlier evaluations had shc-Ti the OVIS test hadX'little effect 
upon achievement of desired student ouLcomes and, as a^result, it 
was dropped froa the career education testing program-,.. Cqnversely, 
^the Career Information Centers had proven to be of value and acti- 
vities were pursued which would enhance their usefulness 

M£magement M , 

^ Yea:r One ." Intejgratibn of 'project "goals with 't^iose^o^ 
district receivec primary attention during the first year. ! As' is 
typically the ca^e, the difficulties associated \T±th integration 
became more severe as project goals were cast into operational 
terms. Abstractiojis are easily accepted. The realities of an 
operational program are more difficult to integrr.te.^ A consider- 
able amount of management effort was directed to developing dis- 
trict staff knowledge about career education end in devising 
viable project activities. 

Year Two . Routine project supervision was extended to include 
developing and conducting graduate in-ser^'ice classes, editing 
and publishing curriculum units developed by participating teachers, 
organizing a cataloging system for professional career education 
materials, and implementing an internal accounting system. A sig- 
nificant amount of time was necessary to structure treatment groups 
to insure project compliance with established evaluation guidelines. 

Year Three . i))uring the implementation-generalisation phase of the 
project, a great deal of energy was directed to establishing 
operational budgets, froiLi district funds, for numerous program 
components. In addition, a number of alternative funding sources 
were explored in an effort to' preserve the, momentum established 
during the tenure of this project. Several proposals, to both 
the district and other funding agencies, were prepared and 'submitted 
In keeping with the charge to develop a generalizable model, 

- nximerpua "loose ends" were consolidat;^d; Th$* fbcu^r i^^ 

activities, was upon those products which had proven most effective 
such as the Community Resource Center, Career Information Centers 
and counselor intejrvention. 

A more detailed listing of project activities is shown in Tabic 2. 



TABLE 2 , 

.._MAiOLACIJmUN0JROOUCT- EMPHASES ' 



TABI£ 2 (continued) 

ACIIVIiy AND PRODUCT EMPHASES 



GOAL mA 




Arranged infomational program vith U.S. Department of 
labor-wage-and-bour-spe'ekliats — 



Developed A-V presentation to introduce students, to O.E. 

Developed computer Career. Interest Survey with Exploring 
Division, B.S.A. ' ' 

Interviewed drop-outs and compiled results for 'project 
and district lise 

Provided C'.E.E.B, Decision-making program (materials and 
in-service) for counselors . • 

Prepared bibliograph7 of materials for counselors and 
librarians 

Field tested Kuder E. Vork 'Values Inventory, Career 
Awareness Inventoiy, and School Interest Inventory 

Collaborated with, district Test .Committee in revising 
the total program 

Provided recorders for all counseling departments 
Introduced counselors to new career guidance materials 



PLACEMENT 



4 



CURRICULUM 



COUNSELING 



MANAGEMENT 



X 



I 
I 



TABLE 2 (contrmed) 




COUNSELING 



MANAGEMENT 



Siffveyed attendance & academic records of sample of 
drop-outs . ^ 

Refined project goals and'^Objectives 



• ' TABLE 2 (continued),. 

^ ' MAJOR ACIIVITY ID PRODUCT EMPHASES 





— m MA 


■ ■ \ 

PIACEMENK 


CURRICULUM 


COUNSELING 


MANAGEMENT 








1. 


2 


\ 

3 


1 


2 


3 


1 


2 


■3 


1 


2 


3 






Developed eleientarjr curriculii guide with county Carev 


\ 




























EducatTonTroJect :^ 




















I 










Established a managed natural area with .science teachers 
and Soil Conservation Service 








X 




















1 ' 


Developed D.E,-O.E. cluster (2 classes added) 








X 




















H 
1 


tforked with State Departnent of Education formulating ■ 
guidelines for Industrial Arts curriculum „ ' 

Ranged for participation of 8flO students in .-Satellite 
Technology Demonstration 

Contacted NASA personnel to develop career aspects of 
Space teciinoiogjr 

t 

Made initial investigation into Agribusiness and Health 
cooperative programs 

Implemented "Vorld of Construction" in°one junior high ' - 


\ 






X 
X 
X 
X 


X 
X 


X 
















1 


Developed special career education guide for kindergarten 










X 


















Assisted in pilot Consumer Economics prograa^ development 
and final revision 










X 


T 
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TABLE 2 (continued) 



MAJOR ACTIVITY Ai PRQbOCT EMPHASES 



Aamms 



GOAL AREA 



,m 



PrepaJed special'c.E. suppleient to district media catalog) 



Increased and up-dated career awareness and guidance 
materials thr.oughout the District 

I ^ ' 

Field tested a variety of affective measureiient instruments 

^ JPrepared bibliography of recommended guidance materials 
glfor counselors and Career Information Centers 



PLACEMEN! 



CURRICULUM 



COUNSELING 



MANAGEMENT 



Published/disseminated teacher-developed instructional u'nitf 



Provided appropriate materials for handicapped students 
at the State School for the Deaf and Blind- and the Easter 
Seal Rehabilitation Center 

I ' 

Conducted a variety of in-service programs, to meet needs 
of different groups * , • 



Participated in state meetings to share development 
problems and successes with other districts 

I Piloted a work observation program at West Junior High 

iveloped brochures oh job-seeking skills, for Career 
Information Centers and teacher coordinators " ^ 



X 
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lAILE 2 (contlDUed) 

MAJOR ACIIVIiy AND PRODUCT EMPHASES 



GOAl AHii I riACEMENt 



iFlloted a prfl-eiplo^Dent cUnle at Great Falls High School 

petired approval for and inpleoented an Agribusiness 
cooperatire prograi In both high schools 

Initiated a night school prograi for high school drop-outs 

' I ICoordinated a workshop for counselors on Sex Equality in 
ylGuidance Opportunities (SBiO) 

1 ' 

Prepared video-tape introductions *o major curricular 
areas for sophoaore orieotatioa 

Sponsored career-oriented field trips in EnvironBsntal 
Education, Social Ecology, Art, Social Science 

I 

Developed a slide-tape presentation of elenentai? career 
activj^ties for }Xk, groups eod others 

ISponsored Junior Postnan.progniB in all elenentaiy and 
ipirochlal schools 

Jftovidil^smle?!^^^ 
Jand Montaaa State Mversity student teachers 



2 



conicuiuM 



COUNSflING 



MANAOEMtNT 



I 
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TABLE 2 (contluMd) 

MAJOR ACTIVITY AND PROOOCT EMPHASES 



C. EVALUATION OP THE PROJECT 



1975-76 Program 

a. Introduction 

Rationajta. In vhisi the final jear of the project, an attempt 
was mal^ to fdcu£9 evalxiation resources upon those components ' 
which hfed the grtyatest potential for fizll integration with 
on-goirgf jMrogr^Sas of the school district. However, this plan 
was comproSlged to some degree by several conflicting demands*' 
For example, the project sponsor needs Infoni^tion about stu~ 
dent outcomes J the project staff needs information about con- 
straints to adoption; and distr ict of'f icialfij^ need information 
about continuing costs, staffing requirements and related 
administration issues. 

Consequently, the evaluation this year lacks rlgoi: in any given 
area but does provide some information for each known group of 
decision-makers. This rationale is consistent with the belief 
that evaluation data will not insure perfect decisions but will 
result in qualitative improvements* The rationale employed 
is a^so consistent with the general conceptual structure of 
the project « Poflnltion, Design, Development^ and Installation. 

Definition for Evatluation Broloyed . Srom the Initial deaign 
effort, evaluation of the project has b^en perceived as a con- 
tlnuour proMM for the constant examination and appraisal of 
those activities and policies >diich enable a rational examina- 
tion of conflicting altemativeQ., As^jmrsued In this proiect,^ 

^ evalxaation has been a means of enhancing and operationalizlzig 
definitions for project Intents and to maximize the benefits 
to derive from consinsption of available resotirces* The intent 
has been to provide Information required for planning and 
managing the project and to ultimately describe the strengths 
and deficiencies of the project relative to desired outcomes^ 

Eval\:|ation Guidelin es. In publishing a set of evaluation 
guidelines for career education, the United Stated Office of 
Education achieved several' positive effects. Most notable was 
a definitive specification of desirable student outcomes for 
career education programs and a systematic procedtare for the 
design and conduct of evaluations* However, the guidelines 
are rather Insensitive to the tot€d context of the public 
schools. Consequently, implementation of the guidelines has 
consumed an inordinate amount of available evaluation resources, 
especially in view of the observable benefits. 

Perhaps the most difficult problem has been the requirement 
for '^treatoent" definition^ In forcing such processes, the 
guidelines result in evaluation data which presents only a 
very limited view of the total program* For example, unless 
- a teacher is both able and willing to use a specific treatment, 
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the probability of that treatment being employed as designed 
and with sxifficient >igor to have the desired effect, is very 
low. 

Career education, by definition, represents a philosophy of 
education - not an isolated project or program. It is more 
tnan a few teachers using a. special set of materials^ for a 
short period. The guidelines have proven relatively insen-r 
sitive to this phenomenon. 7 / ' 

\ i 

Purpose . The purpose for an evaluation in developmental pi'o- 
grams must center upon providing. timely, credible and man-] 
ageable information that will support project staff in meeting 
four basic responsibilities. These are:. 

1. Establishment of meaningful and valid criteria 
for project outcomes; 

2. Effective use of project resources to attain 
project goals; 

3^ Objective and useful dissemination of infor- 
mation to the educational community and other 
concerned publics; and 

Accountability to the sponsoring agency. 

In addition to those basic responsibilities, the evaluation 
plan used this past year has been designed to: 

I»_.D_©.termine^h0_e3rtfint.Ao^vhi^ 

the project were achieved; 

2. Determine what factors either enabled or inhi- 
' bited the attainment of specified objectives; and 

3* Promote the incl^asion of successful project com- 
ponents into school curriculum and vocational 
education programs throughout the school district. 

Procedures . In each of the three, years the project has been 
operatio;ial, tto evaluation has been accomplished in five 
phs^es. These are: (1) Profclem definition; (2) Design; 
(3) Implementation; (k) Reporting; and (5) Management. These 
phases have been employed in an iterative manner, i.e., pro- 
ducts from each phase have been reviewed by project staff, 
revised as^ necessary and reviewed again. 

To insure tiiat informatibn needs of the project sponsor were 
satisfied, the thirteen steps established by the evaluation 
guidelines were divided into the five phases listed above. 
The intent has been to provide the' sponsor with both a basis 
and means, for aggxiegating data from many different projects/ 
The complete evaluation design is included as Appendix A. 
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b. Data Generation 



Introduction, Through a variety of instrumentation techniques 
an attempt was made to describe alternative perceptioiS of sig- 
nificant project components. By focusing data from several 
sources upon a single component it was felt descriptions, and 
measures of effects, would be both more accurate and more rig- 
orous. 

Implementation of the design required the use of standardized 
tests, locally developed questionnaires, rating scales, and 
numerotis elemeiits of record data. Each of these is described 
more fully below. 

Standardized Tests. In the majority of caaes, tests recom- 
mended in the Evaluation Guidelines were used as criteria for 
selected treatments. In some instances recommended tests also 
served as a treatment. For example, the Bjurclay Classroom 
Climate Inventory was used by teachers as a treatment with the 
Self -Observation Scales as the ci-iterion. In other Instances, 
recommeinded tests were used as a' treatment and a locally 
developed rating scale served as the criterion. 

One facet of th« 197^75 evaluation included rating by district 
teachers and counselors of recommended tests for ease of use 
and value of data provided* This rating resulted in a clearance 
in the number of tests employed for evaluation purposes. 

Tests which contributed to this evaluation are listed in Table 
3^ below. A complete description of the test employtaent strat- 
egy i s summa rized in Table' 



TABLE 3 

[ ^ TESTS EMPLOYED 



\. ^ TEST 


Evaluation 
Objective 


Outcome 
Area 


Grade 
Level 


■ ■ 

Self Observation Scales 


1 


I . 


3 & 6 


Career Education Questionnaire 


2 


IV ' 


3 


Career Education Cognitive Questionnaire 


2 


IV 


6 


Career Jfaturity Inventory 


2 


rv 




Career Development Inventory 


3 


IV 


12 


Differential Aptitude. Test/CPP 


1 


I 


9 


Barclay Classroom Climate Inventory 


1 


N/A 


3 & 6 
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TABLE 1< 
EVALUATION TESTING SUMMARY 



Eval. 



Grade 



12 



Population 



School 



Franklin 



Franklin 



North JHS 



K 



2k 



26 



21 



Paris Gitson JHS | 36 

I 



Mountain View 



28 



Longfellow 



27 



Meadow Lark 



■Design 



Tfeatment 



B« C • C • X • 



B«C«C«X« 



DAT/CPP 



None 



Curric. Inf, 



Curric. Inf. 



^1 Curric. Inf. 



Valley View 



?7 



Collins 



17 



Franklin 



'23 



Meadow Lark 



29 



Rusaell 



27 



Franklin 



12k 



Riverview 



28 



Roosevelt 



\2k 



East JHS 



11 



North JHS 



25 



East JHS 



11 



None 



None 



Requirements 



Criterion [Analysis 



sio.s. I t^ ^ * 
^1^2 



S.O.Si^ t 



T T 
1^2 



Self- 
\ report 



T T 
^1^2 



Self- 
report 



T T 



C.E.Q. Pre-post 



C.E.Q. Pre-pqst 



C.E.Q. J Pre-post 



C.E.Q. Pre-post 



Ciirric. Inf. 



CpTTlc. InE 



Jurric. Inf. 



Nonft 



None 



None 



C.E.Q. Pre-post 



C.E.C.Q. Pre-post 



C.E.C.Q. and 



C.E.C.Q. J difference 

een— — 



C.E.C.Q.' I groups 



Career Edu- 
cation Course 



Constuner Econ 
course 



Career Educa- 
1:^ion course 



C.E.C.Q. 



C.M.I. I Pre-post 



C.^I.I. 



C.M.I. 



North JHS 



22 



None 



East JBS 



19 



Great Falls HS 



23 



Great Falls HS 



18 



None 



CEEB: Deci- 
sions & Out- 
comes 



None 



C.M.I. 



C.M.I. 



Pre-post 
and 

post-only 
with compari 
son groups 



C.D.I, 



Post-only 
compari- 
son 



C.D.I. 



= 1975 Baseline group, 



1976 Treatment group, T= Comparison 
-28- group 
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Questionnaires * Six questionnaires were administered to gen- 
erate data for this evaluati-on. The purpose and objective 
addressed by each .questionnaire are shoim in Table 5. 

TABLE 5 

QUESTIOMAIRES EMPLOYED FOR THE ^VALUATION 





Respondent(s) 


Eval. 
Obi. 


Purpose/Focus 




Work Experience Students 

.. 


/ k : 


To determine^ the degree of 1 

job and perceived career 
goals 




Co-op Work Coordinators 

i' 


5 


Identixy tno extent to which 
the number. and type of job 
preparation opportunities have 
been expanded 




Students NOT enrollpd in 
co-?op or work , experience 
programs 


7 


±u,c<iioxjjr cne uxoeno oo wnicn 
Students find available * 
placement service of value 
and the extent to which each 
type available is used 




Students who use the Career 
Information Center 


8 


Perceptions of Career Infor- 
mation Center value in career 
decision processes 




Career Information Center 
Director 


. 8 


Inventory of Career Informa- 
tion Center resources; proce- 
dures for student use of 
Career Information Center 




Teachers who have taken a 
Career Education course 


13 


Determine the extent to which 
the use of Career Education 
strategies is retained 



■ Record Data , Frequently, xinanticipated oulcomes prove more 
valuable than those planned and, in many cases, these are 
■ ' most 'reauily captured and documented through c^o] lection of 
various forms of record data. A summary of these types of 
data which were used in this evaluation is presented in 
Table 6 . ^ 
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TABLE 6 



RECORD DATA WHICH CONTRIBUTED TO THE EVALUATION 

/ 



Eval. 
Ob.i. 


Source 


Description 


k 


Staff 


- Description of work experience program 

- Inventory o^available work experience sites 

- List of work Experience stations vised 

- Listing of^students placed in -work experience 
■ / • 


5 


Staff 


- Number ^c^f job sites available for work experi- . 
ence and cooperative work programs 

- Descj<iption*^of vocational education courses ^ 
. . available ' • 

- Number of job sites used for work experience 
and cooperative work : programs, 1975-76 

- Inventory, of Community Resource Cen^ter materials 


6 


Project ) 
Director 


- Financial report for I975-76 v 

/N 


7 


Staff 


- List and description of placement service s, 
available to subjects (present and former) 


8 


Staff 


- Inventory of Career Information Center materials 

- Total hours of student CIC use 


9 


Center 
Staff 


- Number of requests for service received at the 
.Comiiiunity Resource Center 

- List of community resources inventoried 

- Description of procedure for teacher use of 
community resources 


12 


District 
Staff 


- Description of each of the following project- 
developed components: CIC, CRC, tin-service 
training course, counselor roles ,\ curriculum 
units, special materials development proce- 
dure, work programs, and placement programs 

i 



A more complete description, of data generation and related pro- 
cesses employed in the conduct of this evaluation is shown in 
the total design (Appendix A). Much of the information pre- 
sented there has been purposely omitted from this report to 
simplify the repor.t format. 
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Report of Data Related to Goal Attainment 



Introduction , Data are reported below in a format which em- 
phasizes the outcome areas established by the Evaluation 
Guidelines. The relationship between outcome objectives is 
established in the evaluation design. 

A number of project activities, and related evaluation objec- 
tives,, were not directly related to student outcomes. For 
example, establishment of the Community Resource Center con- 
sumed project resources but did not contribute directly to 
modification of student behavior. These types of activities 
are reported as "Related Activities." 

Self -Awareness I Changes in self-awareness, as a result of 
project participation, were observed at grades three, six and 
nine. At each grade level a pre-post design was planned using 
a criterion judged appropriate for the treatment. However, 
numerous administrative problems were encountered and the ^ 
design for grades three and six was changed to use of X975 
data as a baseline for comparison purposes • 

The treatment at grades three and six was administration of 
the Barclay Classroom Climate Inventory and subsequent use of 
those data by classroom teachers. The criterion was student 
performance on the Self -Observation Scales. 

Data related to this treatment are shown in Table f.vv-r?^': 
were nonsignificant differences in criterion performance 
by treatment groups from 1975 and 1976. 
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TABL13 7, 

SELF-OBSERVATION SCALES PERFORMANCE BI 
■ TREATMENT GROUPS: GRADES 3 AND 6 



Data 
Reported 



Nof 
cases 



I 



Std. 
Dev. ' 



Percrtn- 
Ule 



Group 



A 

b' 

C 

A 
6 
C 

A 
B 
C 

A 
B 
C 



i 



Self 



Acceptance ^^^urity Hfl^itylty finnf|,^an.. iwi^.»|f,>^B f^Wl^^ mm\m 



hi • 

52 

\2 

50.60 
•+5.29 

9.if3 
9.73 

^■51.01 
5i37 . 
^^0.57 



Self 
curi 



^3 
■52 
lf2 

50.05 

55.85 
51.10 

9.'98 

8.39 
13.86 

50.79 
68.56 
56.02 



Social 



^3 
52 
lf2 

51.09 
51.85 
if2.69 

9.85 
7.'l9 
12.38 

56.26 

57.33 
35.57 



Social 



^3 
52 

^ k2 

51.00 

5l.to 
»^3.7\ 

9.73 
7.71 
8.I12 

5hM 
55.25 
32.07. 



Scales 



School 



V ^3 . 
52 
k2 

if9.98 
if9.50 

'8.55 
IO.I12 

11.23 

I16.65 
51.17 
^9.17 



Teacher 



hi 


^3 


52 


52 


lf2 


h2 


»^9.77 


51.58 


52.17 


52.98 




if7.02 


9.00 


. 9.82 


■7.39 


8.62 


12.98 


12.31 


52.28 


56.98 


60.00 . 


60.92t 


^.93. 


if5-.79 



Peer 



Achievement 
MotlTatioD 



^3 
52 

^ h2 

51.00 
if9.69 

■ 6.05 
:5.22 
6.00 

53.19 
I18.96 
50.52 



-]r-Tot8W^76-; 



-1|8t56- 



-to 



X Total - 1975 



' m2 



52.57 



J|8.80 



MM 



hm 



50.72 



»^9^71 
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The treatment at grade nine was administration of the Differ- 
ential Aptitude Test/Career Planning Program and' subsequent 
interpretation by teachers and counselors'; .The criterion em-, 
ployed was an instirument designed to measure student percep-^ 
tions of their own abilities. The validity and reliability of 
this instrument were established through evaluation procedures 
used during 197^^-75. 

These data are reported in Table 8. As shown, the pre-post 
gain in student perception® of their own abilities was signi- 
ficant. 

(TABLE 8 

CHANGE OBSERVED IN TREATMENT GROUP SELF-AWARENESS 

Grade 9» North Jxmior High 

Treatment: DAT/Career: Planning Program 



Criterion: Self -Report of Abilities 



Scale 


X, pre-test 


X, post-test 






VR 


3.36 


3.65 






NA 


3.29 


3.1+2 






AR 


3. 00' 


3.8o- 






S+A 


2.68 


2. 70: 






MR 


3.21 


3.63 






SR 


2.89 


3.15 






SP 
LU 


3.25 
3.50 


3.30 
3.37 


df 




Total 


3.1h 


3.37 


• 27 


-2.26* 



. * significant at .05 level 
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i vareness Of. and Knowledge About. VTork , Measures of student 
p Tf ormance in this outcome area were taken at grades three, . 
six and nine. The treatment at grade three was Curriculum 
Infusion, which was defined for this project as a treatment 
administered by a teacher trained in career education. Com- 
parison groups were employed with the criterion beiug the 
Career Education Questionnaire. 

These data are presented in Table 9. As may be seen, the 
pre-post test difference was not significemt. EoweYer, 
post-test differences between the- treatment and comparison 
groups were highly significant. Available data do not enable 
identification of those factors which may have caused this 
Hifference. 

The treatment for grade s±z was also Curriciilum Iiifusion. 
However, at this, level the Career Education Cognitive Ques- 
tionnaire was employed ao th/e criterion. Data obtained are. 
reported in Table 10. 

As ©ay be seen, the results of this study are pei^jlexing. 
Both the treatment and comparison groups show a decline with 
the compariEuii group performance dropping significantly. 
These data suggest some other factors were operating, possibly 
problems in x,c?st administration. 

For grade nine the treatment employed was a special Career 
Education Unit developed locally. This single trealaient was 
retained from the preceding, year (the ATS-VI Demonstration 
was no longer available) &s it appeared to have, the greatest 
promise.. However, the results, again using the Career Matxifity 
Inventory as a criterion, suggest this decision may have been 
based upon faulty data. 

The results of testing ^ in 1975-76 are shown in Table 11. The 
pre-post test ^^crease proved significant, whereas the gain by 
students in 197^75> shown in Table 12, was significant. In 
further analysis of these data, sho\ra in Table 13, the differ- 
ences between 1975 and 1976 proved not significant. This 
suggests the problem may* be the result of such factors as 
measureiii*§nt error. 

Given the unique nature of 'student populations at this level 
and the associated instructional problems, further analysis to 
identify an appropriate treatment and criterion measure, are 
warranted. 
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■ TABLE 9" 

CHANGE IN AHAREMESS OF, AI|D KNOME ABOOT, VORK 

Grade ] 

Treatment: Curriculiffl Musion (teachers trained in Career BdiJcation) 
Criterion: Career Education Questionnaire (CJ.QJ 





N 


I, pr^ 


, x, post 


df 


, . t 


Treatment 


76 ■ 


17.32 


22.1f5 ' 


2 


2,29 


Comparison 




' 15.15 ■ 


.17.61;- 


2 


. 10.1^8 « 


Treatment 






22.1f5 ' 






Comparison 


K 




17.61 


k 


„ 3.61**^ 



» significant at .05 level, one-tailed test 
♦* significant at .05 level, two tailed test 
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TABLE 10 

. CHiiNGE IN AVARENESS OF, AND KNOmGE ABOUT, m 

Grade 6 / , 

Tteatment: Curriculm Infusion (teacher trained in Career Education) 
Criterion: Career Education Cognitive Questionnaire (C.E.C.Q.) 





. N • 


X, pre 


X, post 


df 


^Treataent 


69 


39.92 


39.89 


: 2 


1 ' 
Comparison 


/ 76 


^.-37 


■ — 


2 


Treatment 






39.89 




Comparison 






38.1^0 


If 



* significant, at .05 level, one-tailed test 
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• TABLE 11 - 
CHANGE IN AWARENESS OF, AND KNOWLEDGE ABOUT, WORK 

Grade '9. East Jtmior" High 

Treatment: Career Education Class, ^1975-76 , , 
Criterion: Career Maturity Inventorj (C.M.I. ) ' 

Competence Test " 



1 



N, pre 


N, Ipost 

\ 


X, pre 


X, post 


df 


. *d 


.5 

1 


i • ■ 

7' 


Ik. Ok 


U.lh 


k 


2.kS * 



* sigaifican,t beyond ,0?, one-tail«w test 



Attitude Scale 



Plo-test 


Post-test 


Change 


Raw Score 




'ReiW Score 


^ile 


Raw Score 


%ile 


3^.6 

L ' 1 


■ 


33.0 




■ - 3.6 


- 15 
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TABLE 12 

CHANGE IN AWARENESS OF, AND KNOWLEDGE ABOUT, WORK 
Grade 9, Kast Juni or High 

Treatment: Career Education Class, 1974-75 Baseline' 

Criterion: Career Maturity Inventory (C.M.I.) 

in- 
competence Test ' 



N, pre 


',N, post 


X, pre 


X, post 


'df 




' 31 ' 


26 


12.1 


. 13.0 


k 


3.11 * 



* significant beyond .025 level, -one-tailed test 



Attitude Scale 



Pre-ti 




Post- test 


Change 


Raw Score 




Raw Score 




Raw Score 


^ile 


32.9 

■ 




37.2. 


66 


+ If. 3 


. 22 



Local percentile 



60 
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TABLE 13 



COMPARISON OF DIFFERENCES BETWEEN 1975 BASELINE AND 
1976 TREATMENT GROUPS IN AWARENESS OF, AND 
KNOWLEDGE ABOUT, WORK 

Grade 9, East Junior High 

Treatment: Career Education Class 

Criterion: Career Maturity Inventory (C.M.I.) 



Competence Test 



1975 


1976 




N 


X, pre 


N 


X, pre 


df 


t. 

1 


31 


12.1 


5 °- 


■ Ik. Oh j If .. 


1.3 


1975 


1976 




N 


X, post 


N 


X, post 


df 


t. 

1 


26 


13.0 


7 


11.7^ 


k 


"1.21 



Attitude Scale 





Post- test 


Post- test 


Chance 1 




Raw Score 


^ile ■ 


Raw Score 


%±le 


Raw Score 


^ile 


1975 


32.9 




37.2 


66 


+ ^.3 


+ 22 


1976 


36.6 


73 


33.0 


58. 


- 2.k 


- 3.6 


Difference 


+ 3.7 


+ 29 


- k.2' 


- 8 


6.7 


25.6 
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Career D ecision-Making Competence , Evaluation in this area 
was lijnited to grades nine and twelve with one treatment es- 
tablished- for each level. For grade nine, the treatment was 
a specially developed Career Education Unit nested within a 
Consumer Economics class. A post-test only design," .with treat- 
ment and comparison groups;^ was employed. ' The C^eer Devel- ' 
opment Inventory served as a criterion. 

These data are summarized in Table Ik. As shown, significant 
differences were oT^served on each of the test scales and on 
the total test. 



> ■ . ■ 

TABLE Ik 

COMPARISON OF TREATMENT AND CCIffARISON GROUP 
CHANGES IN CAREER DECISION-MAKING SKILLS 



Grade 9 . North Junior High '•' 

Treatment: Special Exphasis on Career Education in Consumer 
Economics.. Class 

Criterion: Career' Development Inventory (C.D.I.) 





X, post-test ' ' 


Scale 

Group ' _ 


N 


A. 


. B 


C 


Total 


Treatment 


29 


107.89 


89.13 


16.89 


-207.93 


Comparison 


22 - 


96.13 


159.0 


13.59 


268.73 • 




df , 






h3 . 




t 


1.88* 






11.13** 



* significant beyond .07, two- tailed test 
significant beyond .001, two-tailed test 

\ 



For grade 12, the CEEB: Decisions and Outcomes program was used 
for the treatment and the C.D.I, again employed as a criterion. 
In thin 3tud7, a pre-post test and treatment - comparison group 
pqst--test oxilj strategy was employed. Data ob^tained from pre- 
posV testing for the treatment group 8' =i. presented in Table I5. 
Except for scale B, all po^t-test gains were significant- 



TmE 15 • 

CHANGES OBSERVED IN CAREER DECISION-MAKING SKILL 



Grade 12. CM. Russell Hip;h 

Treatment: CEEB: Decisions and Outcomes 

Criterion: Career Development Inventory (c:D.I.) 



Scale 


X, pre 


X, post 


df 




A 


■ 100.05 


, 113.20 


19 


3-: 81*** 




B 


113.35 


111.10 


19 


0.36 ■ 




c 


16.55 


i3.';-5 


19 


- i.87** 




Total ■ j 


- -229.95 ' 


237.75 


19 


..1.01+* ■■ 





'-** significant beyond ,005, one- tailed test' 
** significant beyond .05, one-tailed test 
* significant beyond .25, one-tailed test 
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Data comparing the treatment and comparison group are sum- 
marized in Table l6. For each scale and for the total test 
score, differences were significant as hypothesized. 



TABLE 16 * , 

' ' COMPARISON OF TREATMENT AND CONTROL GROUP 
CHANGES IN CAREER DEdlSIOK-^IvlAKING ^ SKILL 

Grade 12. CM. .Russell High 

Treatment: CEEB: Decisions and Outcomes 

Criterion: Career Development Inventory (C.D.I.) 





X, post-test 


Group 


■ N • 


A 


B 


C 


Total 


Treatment 


•20 


^ 113.20 


"111.10 


. 13.1+5' 


237.75;4 


Comparison 


30 


106.6? 


. 78.37 


15.5 ■ 


200.53 




df 


1+8. 


1+8 


1+8 


1+8 


t 


5.07*** 


2.61*** 


- 2.13*^ 


6.72**+ 



significant beyond .001, two- tailed test 
significant beyond .05, two-tailed tecit 
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Related Activities, A project which is charged \d.th .developing 
an exemplary program in career education" must necessarily 
address a broad range of activities- These are related to . 
development of specific components for use in classrooms and 
to implementation of the total effort. These diverse acti- 
vities are reported below., 

. . Work exp erience program placement . The Great Falls 

Public Schools have operated -both a work experience 
ancj Cooperative work program for several years . 
However, there has been some concern that perhaps 
the work exiperience program, which offers students 
an opportiinity to , practice in a work situation skills 
learned in a specific class, has not directly sup- 
ported students in their efforts to make career de- 
cisions . ' ^ 

Students enrolled in this program during the spring 
of 1976 were asked to respond to a questionnaire 
which was designed to obtain information about studeiit 
perceptions of the program's effectiveness. Respon- 
dent demography is summarized in' Table 17. 

TABLE 17 

WORK EXPERIENCE PROGRAM STUDENT DEMOGRAPHY 



Age , 




16 


17 


,18 


a9 


20' 






1 


81 


151 


li^ 


1 




% 


.h 


32 


61 


6 




Sex 




J 


M 










n 


128 


120 ■ 










% 


?2' 


if8 








Grade 




10 


11 


12 








n 


0 


1 


2k7 








% 


0 


.k 


99.6 






School 




G?HS 


CMR 










n 




103 










% 


58 


k2 
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Among the respondents, 22? (91.5/S) reported i^ey had 
made a career goal decision and 21 {8.3%) reported 
they' had not. Representative career goals included 
the following: - . j • 

- Nursing' (health. related work): ^ ' 
' . - Accountiiig (office management) 

- Business (marketing) 

- Recreation 

. Education - - < . 

- Photography 

- Home economics 

- Military ■ 

- Dental assistant 

- Interior decorating 
' - Medicine 

- Continue in present position arid work up 

. - Communications (radio) (telephone) (electronics) 

- Agriculture 

- Real estate 

- Fish and game (wildlife) 

- Butcher 

- Carpenter ' ' ' 

- Auto/truck luechanic- 

- Rancher ■ ' 

- Law enforcement 

- Contractor (building) 

- - Advertising . / 
' - Retail business [ / 

- Tinicking \ / 

In nearly every case, students liVt^ more. than one 
cafeer goal, indicating that decisions made were only 
tentative. However, the important data from this 
question is that all students had at least an opinion 
about wh^t they perceived as Career goals. 

When asked if the work experience program had helped 
them clarify their career goals, 201 (8l$g) responded 
affirmatively and if? (195?) responded negatively. When 
asked how the work experience program had helped clari - 
fx: career goals, the- following types of responses were 
received: 

- Gained confidence and experience 
-Gained knowledge of own abilities 

- Learned about working in chosen field 

- Learned how to get aldng^with people 

- Learned what I didn't want to do 

- Learned about jobs in wh' ch futures are very 
limited . . ♦ 

- Learned skill requirements for a chosen career 

-44- • • 
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. - Goals becsane real, instead of a dream or vish 
-Learned how to take orders and how this is part 
of a career ' ' ^ 

- Provided me^with a bropd range of experienc^ 

When asked why the work eiq)erience progrjam had not 
been of value in clarifying goals ,^ some students 
responded as follows: ^ ' 

- I only wanted to make some money 

- Nothing I have done is related to my chosen 
career 

- Didn't have that type of job 

- Have only learned what I don't want to do 

Enrolled .students' were asked what they perceived as 
the most and least satisfying aspect of the total work 
program. Their responses are sumniarized in Table 18, 
on the following ps^. Unfortunately, many students 
were, looking upon the work experience program as a 
means to g;ain full-time efoployment in order to support 
themselves. This indicates a need to more fully: in- 
form students about the. intent of work experience and 
about other work programs available through the 
schools.' It also suggests a need to effect tighter 
integration of .student needs and school programs, 
i.e., perhaps those, students; who have 'a strong 
need for financial independence should be enrolled 
in a program which enables them to work full time. 

Finally, this group of students were asked. how they 
felt the program could be improved. Suggestions made 
included the following: 

- More discussion about the program with our 
teachers 

- Greater number of options 

- Higher pay for students 

- Improved scheduling procedures 

- Mote independent study in regular courses 

- Increased employer .supervision 

- More appropriate homework assignments 

- Include professions 

- Adjustable hours of work 

- Increase salaries 

- Improve placement efficiency and effectiveness 
• to insure greater similarity between interests 

and work 
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TABLE 18 



STUDENT PERCEPTIONS OF THE MOST AND LEAST 
SATISFYING ASPECTS OP THE WORK EXPERIENCE PROGRAM 



CHARACTilRISTTr <5 


Most 


Least 


n 


% 






Salary/Vagea 


8S 




ko 


16 


Released time from school 


27 


11 


50 


20 


MeanlngfuliiBss of experience 


101* 


k2 


20 


8 


Range of experiences 






20 


8 


Other 


0 


0 


65 


26 



Representative cooaaents: 

e- 

MoBi Satlsfyj^ ff 

- Experience 

- Learned about public 

- Inc •eased special skilla 

- Enjoyed vorklng 

- Learning on the Job 

- Making a contribution 

- Feel useful 

- Money for college 

- Meeting different people 

- Variety or work 



Least Satlafvj,n(r 

' Vant tp work more houra 
Keeping up vlth flchool 

- Some of the people working with 
Mies school friends 

- Not related to ^areer goals 

- Work hours are difficult 

- Lack of time for other activities 

- Salaries are too low 

- Being treated as a student while 
on a Job 
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Student respondents who participated in this study 
were apparently well qualified to rate the program 
as evidenced by their employment history. Over 9556 
had been employed in more than one position, both 
the same ac^ and different from those positions held 
presently. T^ical of Jobs held previously by re- 
spondents were: 

- Business office (secretarial) 

- Personal services 

- Sales 

- Recreation 

- Child care 

- Health services ^ 

- Construction 

- Agriculture/farming - 

- Trades (plumbing, carpentry^ masonry, etc.) 

- Miscellaneous labor 

2» Expansion of Job preparation opportunities . During 
the three year tenure of the project, there have been 
a number of changes in selected aspects of the co- 
operative work program. Several of these have been 
the direct result of intervention by the project 
staff. A summary of the total enrollment for, 
1975-76 is shown in Table 19. Also sho\m is a minor 
drop in total enrortoent from 197'f-75, but a signifi- 
cant increase In .nwber of work stations inventoried. 



TABLE 19 

COOPERATIVE WORK PROGRAM SDMMARI 



Prograa 


School 


1 , . 

Students 


VOFk 
Stations 


Total 


Students 


Work 
Stations 


tributive 
nation 


GFHS 
CMRHS 


72 
60 


70 


72 
60 


70 


Industrial 

Cooperative 

Education 


GFKS 
CMRHS 


ko 


35 
200 


J+0 
27 


35 
200 


Office 
Education 


GFHS 
CMRHS 


21 


65 
25 


56 
21 


65 
25 


A^^ibusincits 


GFHS 
CMRHS 


■ I 




15 
25 


25 
26 






Program Total 


316 


520 j 




Change (1975 to 1976) 


- 13 


*183 1 
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The drop in enrollments is an especially important 
element of data as it was clear in 1974-75 that coor- 
dinators ' student loads were too heavy. Coupled with 
the increase in number of coordinators (from 9 to 11), 
the student load for each coordinator dropped from 
over hi to 28. Other important aspects of the progrpun 
are summarized in Tables 20 and 21. Generally, there 
have been several positive changes, e.g., the increases 
in use of student career objectives as a criterion for 
selection and site asoignment. 

TABLE 20 

CHANGES OBSERVED IN COOPERATIVE WORK COOROIMTOR 
PROBLEKS AND ACTIVITIES 
Average number of students supervise 



197^+ 


1975 


1976 


2k 




28 



Conduct a formal atudent traininp program 





197'^ 


19*75 


1976 


n 


5 ,| 


1 9 


11 


yes 


20^ 


7856 


1856 


no 


m 


22% 


82*? 



Criteria emoloved to select students 



! CRITERION 


197»* 


1975 


1976 


Completed Pre-requisites 


78 




100 


Attendance 


100 


100 


82 


Attitude \ 


100 


86 - 


82 


Grades \ 


82 


100 


55 


Economic need \ 


38 


0 


27 


Career Objectives 


73 


92 


100 


Employability 


76 


90 


73 


Student Educational Plans 


58 


53 


^5 


Teacher Recomoendations 


ei 


20 


27 
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^^ . TABLE 21 . ■ I 

CONGRUENCE BETWEEN COOPERATIVE WORKiPROGRAM / 
\ASSIGNMENTS AND STUDENT CAREER GOALS ' / 



PROGRAM 


Percentage of students supervised 


0 ! 


10-30 


31-50 


51-70 


71-90 


91-100 


/ 

Distributive / 






50 


50 






Industrial 

Cooperative 

Training 








100 






Office 
Education 








30 . 


ki 


J 

89 


Agribusiness 






50 


50 







Cell entries are percentage of coordinators who estimated each cate- 
gory of student percentages whsore job assignments were congruent with 
career goals. 



The tremendous change in use of fbriSal training pro- 
cedures was alarming when first noted. However, 
ftirther investigation revealed that more coordinators 
had adopted m individualized form of training which 
th©7 did not classify as ^'formal." Again, further 
imvestigation revealed that the procedure for indi-» 
vidualizing programs was S70tematlC| which allowed 
coordinators to adjust training content to indivi- 
dual student needs « The program has thus shifted, 
rather significantly, from a traditional, formal type 
of training to one which is individualized. 

When as^^edsjAat, th^ perceived as the most signifi- 
cant constrai3i^s tio operation of tlie cooperative work 
program, coordiitaL^rs cited the following: 

1. The absence oFs^ Agribusiness program in 
the summer when more sites are available; 
-49- 
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2. Competition with non-cooperative students; 

3« Too many sites to inventory and maintain; 

k. Lack of clarification of differences between 
cooperative work and -work-experience j- 

5. Indecisiveness of students, re, career goals; 

- 6. The program ij too diverse; and 

7. ^inphasis on employability of students. 

3- Report of Financial ExpendltttrBa . This information is 
presented In Table 22. 



TABLE 22 
PROJECT BUDGET REPORTS 



Expenditures 


Level of Itaphasis 






7-12 


7-9 


10-12 


K-12 


■ Total 


Personnel 

Professional Salaries 
Clerical Salaries 
Employee Benefits 

Travel 

Supplies & Materials 
















18,600 




18,700 


26,Q4o 


79,260 








4,^20 


5,262 


9,682 


2,261 


2,793 




3A55 


4,788 


13,300 


1,35^ 


2,200 


m 


• 3,504 


1,416 


8,964 


4,067 


2,556 


3^852 


2,772 


2,049 


15,296 


Communications 

Services 

Equipment 










1,190 


1,190 










6,370 


6,370 








1,308 


726 


2,034 


TOTALS 


52,80lf 


26,llf9 




34,162 


48,641 


136,096 



^* Developme nt of a Coordinated Placenertt Service , A con- 
tinuing concern of project staff has been the lack of 
coordination betwen available placement services and 
their effectiveness in satisfying student needs. 

Prior to initiating a major develcpoeoat effort, it was 
i^elt prudent to .estab^ l^h a data b^se which would define 
the problem with greater precision. 
-50^ 
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One dimension of required data was identification of 
av^vileble sarvicss. Of special concern were: (1) the 
naaes of tgencies located in Great Falls; (2) their 
addres-ies; (3) services offered; (k) fees charged; 
(5) an/ part-iculrr affiliation they maintained, such 
as a gcvemmeJvl; agency; (6) hours of operation; and 
',7; apr,-;ial placement emphasis they engendered. This 
iniToraaUcn was informaUy collected and not reported 
here ae it does not lontribute to the project evalua- 
tin-:. 

A second dijaension of the required data base was iden- 
tification of the degree to which placement services 
were used by students, by which students, and perceived 
effectiveness of available services. A sample of 30 
students working locally was asked to respond to a 
queationnaire designed to elicit the needed informa- 
tion. Shown in Tables 23 through 2? are: (1) re- 
spondent demography; (2) respondent employment his- 
tory; and (3) respondent use and rating of available 
services. 

Perhaps the most significant resiats of this survey 
are the following: (l) the number who had not gradu- 
ated from high school (86^) ; (2) over 5056 were not 
currently employed or had not been previously employed; 
(3) the number of students vho did not use a placement 
service to find employment (83^); and (h) the number 
of students who found those services they did use very 
useful {60%) and readily available {60j(,) . 



TABLE 23 



PLACEMENT STUDY RESPONDENT DEMOGRAPHY 



Age 






i5 


1§ 


iZ 


18 


i2 




n 


1 


2 


8 


10 


7 


3 




% 


3 


6 


25 


1 32 


22 


. 9 


Sex 




M 


F 












n 


12 


19 












% 


38 


61 










, Grade 








11 


12 








n 


9 


8 


11 


13 








% 


29 


25 


35 


9 






Graduated from U.S. 




Yes 


No 












n 


1 


30 










I 1 


% 


3 1 


96 
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TABLE 2k 

PLACEMENT STUDY RESPONDENT EMPLOYMENT HISTORY 



Currently Employed 



Previously Bnployed 





Yes 


1 No 


n 


11+ 


17 




h5 


3h 




Yes 


No 


n 


n 


18 


%* 


35 


58 



no response by J% 



TABLE 25 

USE AND RATING OF EMPLOYMENT AND/OR PLACEMENT SERVICES 



Used a service to find employment 


Yes 


No 






n 


5 


26 






t 


16 


83 






Usefulness of services 


Very 


Some 


Little 


None 


n 


3 




1 


1 


t 


60- 




20 


20 


Availability of services 


High 


Low 






n 


3 


2 






% 


60 


ho 






General rating/placement 


Very cood 


Good 


Poor 




services 

n 


1 


3 


1 


-0- 


% 


20 


60 


20 


-0- 
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The following is a representative y:J>^,inz of factors 
students cited* being considered in. making an over-all 
rating of placement services they did use: v 

"...personnel were very understanding • " 

"...people have done everything possible for me." 

"...the availability of such services." 

These data suggest the following: 

1. Many respondents had no career goals; \ 

\ 

2. Respondents either did not know about a li- 
able placement services, did not need tuem, 
or were unwilling to use thexa; and 

3. V A need exists for strengthening placement 

through an information program targeted at 
teen-agers and for coordination of services 
among agencies. 

Use and Influence of Career Information Centers , In 
conjunction with an intensified career counseling pro- 
gram throughout the district, Career Information Centers 
were established at each of . the high schools. Each 
center was charged with the same responsibilities but 
were different in that one had a full-time staff person 
assigned. 

As reported last year, librarians were directed to 
place career oriented materials in these centers to 
facilitate student acquisition and use. Operationally, 
the centers remain unchanged from the past year with 
one exception. An emphasis. is now placed upon career 
clusters in organizing the collections. 

Staffing for the one center, this year, has relied 
more heavily upon the use of para-professionals. 
Generally, this strategy has proven effective. 

Student perceptions of* the usefulness of the Career 
Information Centers are described in Tables 26 and 27. 
Perhaps the most significant finding shown is the 
number of students who found the centers useful in 
making a career decision. 



TABLE 26 

CAREER INFORMATION CENTER USi^GE 
(Center Vflth Staff Person Assigned) 



User Demography (n=86) 



Age 



Sex 



15 



M 



16 



17 



18 



M 



M 



19 



M 



Grade 10 



11 



2k 



18 



Grade 11 



Grade 12 



18 



Cell entries are number of users. 



Reasons for usinp the CIC 

Own Choice - 27 

Counselor Referral- 5 
Teacher Referral ^ 
Other Referral - 16 



Usefulness of the CIC 

In finding a job: 

Yes - 25 

No - 36 

*" Not expected - 55 

In making a career decision: 



Yes - 65 

No « 18 

Not expected - 19 



TABLE 27 

CAREER INFORMATION CENTER USAGE 
(Center without Staff Person Assigned) 



User Demography (n=26*) 



Age 


15 


16 


17 


18 


19 


Sex 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 

] 


Grade 10 


5 


8 


9 


k 














Grade 11 






















Grade 12 























Cell entries are number of users. 

* This sm:vey was conducted with only one class. 



Reasons for using 'the CIC 

Own Choice - 3 

Counselor Referral -NA, 
Teacher Referral -23 
Other Referral - NA 



Usefulness of the CIC 

In finding a job: 

Yes ~ 2 

No ^11 

Not expected - 13 

In making a career decision: 

Yes - Ik 

No ^8 
Not expected - k 
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CoiDinunlty Resource Development s This project activity 
has met with a high degree of acceptance from the outset, 
indicating that it satisfies a well defined need. Usage 
data for 197^75 and 1975-76 are presented in Table 28. 
The increase in number of users and number of resources 
used is especially significant in that; (l) a teacher strike 
in the fall of 1975 delayed use of the center for at least 
one monthj and (2) the project has not advertised, or in 
any other way stressed, the center services. A complete 
description of procedures used to initiate and operate 
the center is included in Appendix C. 
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TABLE 28 



USE OF COMNfCJNITY RESOURCE CENTER 



SCHOOL 


No. of Users 


No. of Resoiirces Used 


1975 


1976 


1975 


1976 


CMR'High School 

Great Falls High School 

East Junior High 
North Junior High 
Paris Gibson Junior High 
West Junior High 

Chief Joseph 

Collins 

Franklin 

Lewis Sc Clark 

Lincoln 

Longfellow 

Lowell 

Loy 

McKinley 

Meadow Lark 
j Morningside 
1 Moun + flin VI ciTj' 

Riveinriew 

Russell 

Skyline 
Siumyside 
Valley View 
Vhittier 


6 

. 9 

10 

7 
1 

3 

3 
2 

5 
1 
1 

6 

3 
6 

k 

2 
1 
11 

7 
1 
2 
k 

9 
2 
k 
2 


9 
5 

5 
8 
k 
2 

1 
1 

6 

9 
1 

k 

2 

12 
6 

6 

13 
11 
6 

-3 
1 


7 
20 

26 
Ik 
2 
6 

5 
•3 
8 
1 
2 
11 
5 

14 
27 

1 

24 
Ik 

1 

2 
12 
24 

3 
7 
3 


39 
15 

20 
19 
29 
5 

1 
1 
8 

16 
2 

X 

56 , 

1 
X 

29 

8 

13 
54 
25 
13 

1 

2 


Sub-Total 


1X1 


124 


232 


362 


j Deaf & Blind School 


k 


3 


7 




Parochial Schools 

Holy Family 
I Our Lady of Lourdes 
St. Gerard's 
St. Joseph 


1 
1 
2 
3 


1 
1 

2 


3 
1 
5 
7 


3 
1 

2 


Other* Agencies 




9 




47 . 


TOTAL 


' 122 


Iki 


255 


4 17 
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Conclusions and Recommendations 

Introduction. Problems Internal to the district, such as a 
. teacher strike, had a debilitating effect upon the momentum 
generated by project staff during the preceding years. How- 
ever, this type problem was not singularly responsible for 
dif f i culties . encountered . 

From the outset, the conceptual model for the project had 
emphasized the need to focus upon implementation of validated 
strategies during the third and final year. Numerous condi- 
tions, imposed upon the project virtually negated the opportu- 
nity to establish and pursue implementation goals. As a 
consequence, it was necessary for the project to continue in 
a developmental mode, rather than adopt .an implementation plan. 

qqnclusions. .Data presented in preceding sections support the 
following conclusions; 

1. Self -awareness: 

(a) Grade three and six: Even in the absence of comparison 
groups, there is some e\rLdence tha!. the B.C. C.I. 

has some positive effect upon student self-awareness. 

(b) Grade nine: Significant gains in studen' eeptions 
of their abilities were observed when tlie ^uT/CPP was 
used as a treatment. 

2. Awareness of, and knowledge about, work: 

(a) Grade three: Teachers trained in career education 
have a greater influence than those who are not 
trained on student bareness of, and knowledge about, 
work. 

(b) Grade six: Curriculum Infusion, as a treatment con- 
dition, did not have a significant effect. 

(c) Grade nine: The -special career education class had a 
significant effect. 

3. Career decision competence: 

(a) Grade nine: A career education unit, used in the 
context of a consumer economics class, had a highly 
significant effect. 

■* 

(b) Grade twelve: The CEEB program, . . .sions and Out- 
comes, had a significant effect upon student perfor- 
mance on the selected criterion. 
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^. Placement practices: 

Several important data bases ha!\re been established for use 
in initiating development activities 

5. Expansion of job preparation opportunity: 

A number of important improvements have been made in this 
program including a reduction in the student/supervisor 
ratio, increasing the number of training sites inventoried 
and individualization of training programs. ' 

6. Report of financial expenditures: 

Excellent records were maintained by the project director 
which insured the absence of comingling of district and 
project funds. Judgements about the distribution of funds 
are left to the project sponsor. „ 

7. Placement service coordination: 

The necessary data bases for problem identification and 
initiation of development activities were established. 

8. Career Information Centers: 

These centers continue to be well received and used by 
students. There is some evidence to suggest they have 
proven influential in student career decision-making. 

9. Community resources: 

The number of resources inventoried, and use of those 
resources by teachsers, has continued to expand. This 
component of the project may ultimately xirove to be one 
of the more significant - both in terms of its capa- 
bility 'of providing .students with needed experiences 
and in heightenii:ig tsareer education awareness among 
school staaT and tlie communit^^^.. 

Unfortunately, jnany important project effects have not, and 
cannot, be adequately documented. Perhaps the more important 
of these has been the unpretentious, but very effective, manner 
in which the staff has supported district teachers with a sub- 
sequent increase' in teacher sensitivity to, and knowledge about, 
career education. These activities have been most highly con- - 
gruent of all project efforts with the belief that career edu- 
cation is more than another program to be installed by adminis- 
trative fiat. 

l^rhile it is possible to develop a program in isolation from the 
proposed context of use, and the persons for whom it is designed 
such tactics have historically failed. There are exceptions, 
but they have been very costly 'and consequently few in number. 
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This project has been especially sensitive to the product 
utilization context and to insure that target audiences were 
closely involved in product development* These policies, and 
energent strategies, 'have had an implementation effect not 
amenable to standard measurement techniques. 

Recoffimendations > The following recommendations are based upon 
data presented in this report, preceding i'eports, and general 
observations of the project: \ 

1. A set of objectives directly related to implementation 
of fully developed components should be established and 
resources allocated to their attainment. 

2. ^^Policy recommendations should be madfr^ to the District 

Trustees which will facil:lxiete establishment of a context 
conducive to continued support of career education concepts 

3- A plan for coordination placement services should be 
developed and implemenl^d. 

k. Necessary policies 5?U:mld ba established which will ensure 
enrollment of a highisr proportion of working students in 
school sponsored programs. 

5. Budget procedui-es should be considered wmch ^ri.11 ensure 
continued operation and/or expansion of the folloving 
components:, (a) staff training; (b) Community Resource 
Center; (c) Career Information Center; and (d) couiiselor 
intervention for career purposes. 

Evaluation Outcomes 

This is the final report of an intensive, tliree-year, developmental 
effort. A summary of major outcomes is presented below to provide 
the reador with a comprehensive overview of the total program. 
Detailed information from which this summary has been derived r.ey 
be found in earlier sections of this report and in previous 
interim reports. ^ 

Year One. The more significant evaluative conclusions from Year ^ 
One were: 

a. Derivation of a workable model to guide program development and 
establishment of necessary management procedures to implement 
the model were completed and proven successful; 

b. A staff training program was initiated which reached over 10^ 
of th^ District professional staff. A 3ignif::cant increase in 
the mimber of career education strategies used was noted among 
those teachers who completed the progruxa; 



c. A career education reso'orce base vas initiated and coordinated 
with aequi:?ivion and cl stribution procedures einployed hy both 
tile sc- :Ool libraries and district media center; 

d. Data ob^^ir;'^>d from experimental use of several tests were used 
to desijp' >:n elementary career counseling program; 

e. Counselor attitudes toward career counseling and placement were 
shown to be positive but that several constraints exist which 
prevented their pur-u^ag this role; 

f. A strong r ,y ^nt pi^ocedure was implenented which proved to 
be highly >a^ .ve for planning and resource allocation pur- 
poses. 

Year Two and Three. Pvblication, and required implementation, of 
evaluation guidelines by the project sponsor necessitated signi- 
ficant changes in evaluation procedures employed during the two 
final years of the project- Satisfaction of 1>he guidelines re- 
quired delineation of specific treatments and, where possible, 
determination of the .statistical significance of observed effects. 
Consequently, it is more expedient to report the evaluation out- 
comes for thesD two years in a different fomat. These outcomes, 
including both student outcomes and related activities, are sum- 
marized in Table 29. 
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TABLE 29 

SLM OF MTIOfl OOTCOI© FOR KARS TVO AMD THREE 




3 
0 

9 



10 

11 

Q 

9 
12 

11-12 
: 10-12 
1 

10-12 
10-12 
1-12 
3-12 



Self-Avareness 
Self-Avsreness 
Self-Awareness 
Vork Avareness 
Uork Awareness 



or]',; Awareness 



Baiic Skills 
Career Decisions 
Vork Awareness 
hfi. Aware: OSS 
Car-jer Beci^ions 
Career Decisions 
Ilk 
HA 

KA 
NA 
HA 
NA 



*S = 3igi::ficant; N.S, = 
2 = Year Two; 3 - Year 



Barclay Classroom Climate Inventoiy 
Barclay Classroom Climate Inventoiy 
E.A.T, /Career Planning Program 
Curriculum Infusion (teacher trained in career ed.) 
Field trips, resource persons, curriculum infusion 
Curriculum Infusion 
ATS-VI Demonstration Program 
ATS-VI and Counselor intervention 
O.V.I.S. test interpretation 
O.V.I.S. and CEEB/DM used by teacbi.!- and co^inselor 
Oae of the Career Inforaation Center 
Student maturation 
Curriculum Infusion 
'EEB Decisions & Outcomes 
Curriculum Infusion 
Career Education class 
C.E. Unit in Consumer Economics 
C.E.E.B. Decisions k Outcomes 
Work Experience Program 
Expansion of job preparation program 
Progrpja management 

Coordination of job placement services 
Career Information Centers 
Coaunity Resource Center 
Curriculum Guides 



Criterion 


Effects* 


s. 


N.S. 


N^bs! 


S.O.-^ 




3 


2 


s n f? 




3 


2 




2 ■ 














r i T 


2. 










2 




P ¥ T 




2 






2 






1^ W T 




2 








2 








2 




i r n 


2 






T ? Q C 




2 




CUT 




2 




n 7 r n 




3 




fl M T 








C.D.I. 


3 






C.D.I. 


3 






judgement 


2-3 






judgement 


2-3 






NA 


2-3 






judgement 


2-3 






student use 


2-3 






teacher use 


2-3 






NA 






2-3 



Three 
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D. PROJECT OUTCOMES 



1. Introduction 

* 

An extensive discussion of the developmental procedures to be em- 
ployed by the project was presented in the first interim repor 
The model proposed included three "Levels cf Development." Vh-.^e 
these "levels vere n.ot intended to be cougruent with years of 
project operation^ th^^r^ is a ^^tui-al correspondence, and some 
overlapping, betweea tho two. 

The general rationale wasf in e systematic manner, to define 
compomeuts for a "transportable" model, design and develop each 
component, and then focus upon implemented i,! on of those components 
within the district. These procedures are consistent with general 
system theory, which predicates acco!aplishment in a linear mode. 
However, the complexities of an operational school system prevent 
maintaining linearity in development and implementation. Too many 
variables interact in an uncontrolled and unpredictable fashion. 
Consequently, design> development and impleaentation were found to 
occur simultaneo* ^ly in many instances, with strategies for im- 
plementation being involved before product design had been completed. 

These occurrences were "consistent with findings ftom a recent 
R.A.N. D. steady of educational change-agents, which identified 
three implementation strategies as most effective. These were: 
(1) local natorialo de\relopmentj (2) on-going, concrete staff 
training; etnd (3) iterative, on-line, planning combined with 
frequent staff meetines to obtain desired and necessary feedback. 

Each of these stratisgies has been fully employed by the project 
dur.l^ig the past three years, with the effectiveness of each clearly 
established in published evalu^^tions. One factor not cited in the 
R.A.N. I), study, the resoluti . of po/dcy and/or legal constraints 
to implementation,, has also >nn addressed the project. Addi- 
tional work remains to be done in this latter ar<pa. 

In any social context, whether it be education or some other social 
service/activity, the concept of implementation remains sfaml- 
taneously ambiguous and complex. This is largely a result of the 
idiosyncratic requirements of each setting in which implementation 
is to occiir. The problem thus becomes one of determining, for 
each setting, which variables are most significant and developing 
a plan for manipulation of those variables. 

Because the "riaos" for implementation and/or generalization are 
different for each situation, it is virtually impossible to identify 
a conmon set of data which will faoilitace implementation across 
a range of settings. In this sense, the charge to the project by 
the sponsor to develop a "generalizable" model was somewhat naive. 

--ea- 
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However, the Center for Vocational-Technical Education at Ohio 
State University has developed a set of categories for describing 
an innovation which thsy feel closely approximates a "common data 
base" for implementation i The five categories named are: 

a. Characteristics of the innovation; 

b. Social context of the educational organization; 

c. Characteristics of organizations j 

d. Characteristics of individuals; and 

e. I/Ogree of Acceptance, adoption, or installation. 

Each of these categories axe described more fixUy in a docniment 
entitled ^'Meas^ores for Diffusion Variables" published by the Center 
for Vocat; onal Technical Education,** 

Given the complex nature of diffusion^, it would be presumptiwus to 
believe this project could satisfy the Implementation information 
requirements of all potential adopters of project components. Con- 
sequently, this report. has provided a description of Great. Falls, 
the Great. Falls school system, a listing of components developed 
by the project, and a listing of project components which have been 
fully institutionalized. Potential adopters are urged to carefully 
examine these data before making adoption decisions. Full descrip-- 
tions of each component listed below are included in earlier re- 
ports published by the project. 

Component Development and Integration 

Listed below are products whjrch have been developed by the project, 
developed by others with assistance from project staff, or have 
emerged as a result of project influence. 

An example of this latter might be a "career comer'' in ^^Iv-^ 
nentary :?lassroom by a teacher who learned about such str^ e ;.^ i,>.:, 
through the staff training program conducted by the pr;J^^b/ 

The pervasive nature of career education and staff activities makes * 
it difficult to identify*, in a discrete way, those products which 
have been fully intcg:: .«itt?rd into on-going achool programs as a 
direct result oC the project. There will remain, upbn termination 



These were described as diffusion variables rather than implemen- 
tation factors. The differences between implemfijitation and dif- 
fusion are in levels of abstraction far operations, "^npt in the 
basic concept. Implementation referrs to hoy diffusion"-is effected. 

Kester, Ralph J. and Gallagher, John V. Selected Measures of . 
Diffusion Variables . Center for Vocatio^Eial-Techni^jal Education, 
Columbus, Ohio, 197^. _z:a_ , - 
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of the project,, many forms of career education which have become 
fully integrated components of on-going school programs. There 
will also be several current career education activities which 
will terminate with the conclusion of the project* 

Listed below are specific career education products and/or acti- 
vities which can now be observed in district programs. All of 
them have been the result of some form, direct or indirect, of 
project influence. Those identified by an e:sterisk (*) will remain 
operational within the district upon termination of the project, 

*- Career Information Centers 
Community Resource Center, 

An information slide-tape about career education 
*- Courses within the curriculxun, including: 

* (a) Agribusiness 

* (b; Child Care Services 

* (c) Food Services - 

* (d) Consumer Economics 

* (e) Library Skills 

* (f ) World of ConstructioI^ 

* (g) Elementary School Phot-ography 
* -(h) Magic Circle Human Development 

* (i) Career Education 

* (j) Sales & Sales Promo+.ion 

* (k) Management 

*- A special career-oriented night school program which 
fimctions both as an alternative high school and adult 
education program 

*- Special rf^source collection, including field trips, 
r^^source persons and mediated r aterials 

- Student operated "stores^' 
*- Work Experience 

*- Cooperative Work program 

^- Materials identification, acqtiisition and distribution 

- Staff training in the following areas: 

(a) dovelopiajs student self -awareness 

(b) increasing student career decision- 
making competence 

(c) increasing student awareness of, and 
knowledge about, careers and work 

(d) career educatioi? strategies 

(e) career education resources 

^- Para-professionals and instructional aides in career 
education 

Career education in Special Education 

- Placement services for: 

(a) work programs 

(b) employment upon leaving school 

- School-community relations program 

*- Joreer component for the art curriculum 

- Mini-course program 
Instructional Ma :erials Catalog system 

*- Adult education and G.E.D. programa 
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*- Interpretation of O.V.I.S,^ scores for better student use 
*- Junior high group counseling for underachievers 

- Video-tapes of curriculum offerings at Great Falls High 

- Career education pamphlets 

Model Definition 

Development of a "transportable" model has been perhaps th° most 
difficult task addressed by the project. The basic problem is one- 
of defining a set of career-related student outcomes, and the 
necessary strategies to attain those outcomes, which can be inserted 
into operational curricula rather than imposed upon them. 

At this point, the program structure presented and discussed 
earlier in this report would serve as the most useful "trans- 
portable Todel" for career education to emerge from this project. 
The activities ari outcome areas included are derived from relevant 
literature and supported by their use in other career education 
programs. The treatments listed are those which have been designed 
lis.ed ar.d evaluated in earlier project activities. The effective-' 
ness of each is described in Section C of this report. To the 
ejctent that other settings are identical to the conditions which 
exist in the 3reat Falls Public Schools, similar results mav be 
expected. ' 

Dissiemination 

The project was not charged .,.>h specific dissemination respon- 
sibilities. However, selected sections of this report could prove 
valuable to other agencies implementing, or interested in, career 
education programs. Those sections are: A. Description of the 
n-oject; C-2. Evaluation Outcomes; and D. Project Outcomes. 

Funds for guch dissemination activities have not been included in 
project budgets. 



E. GENyiAL CONCLUSIONS 

The Project 

During the past three years, ntimerous developmental activities 
have resulted in products and processes of known effectiveness in 
achieving desired student outcomes • Each of these has been pro- 
duced, to satisfy a particular requirement of the model used to 
- structure the project and identified needs within the Great Falls 
Public Schools. 

Typical of all developmenteil projects, 'some produoxc proved in- 
effectual. However, these types of "wheel spinning" activities 
have been held to a minimum through a comprehensive evaluation 
program and close management procedures. . 

Generally, it can be stated the project has satisfied the intents 
of proposals submitted and met specific requirenents of the project 
sponsor. 

The Program c ' 

The intensive program initiated by the project has resulted in a 
greatly ^ enhanced sensitivity to career education among all district 
staff. For example, in the 197^ Annual Report nearly- every school 
cited use of one or more products developed by the' project. Addi- 
tionally, reports from curriculum committees heavily emphasized 
emerging units and/or objectives related to career educatioiT. 

As a result of the proje^^t,, career education has become a signifi- 
cant facet of mblic school ^.rograms in Great Falls and has had an 
important role in enhancing, ,not supplanting, educational processes. 
Through the project, a program has emerged which reaches all levels 
in the schools, closely involves the commixnity, and provides a 
means to m^.x^a education re meaningful and relevant for all stu- 
dents. 
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SECTION I 



PROJECT STRUCTURE AIID ORGANIZATION 



Elementg of Career Education , A contemporary surge of interest in 
career education resulted in a proliferation of opinions about the ' 
concept and definitions for elements felt to be critical components 
of career education programs. The resultant ambiguity was partially 
clarified by a set of evaluation guidelines developed under contract 
. by Development Associates, Inc. 

However, the guidelines were necessarily general in natiire and did not 
provide sufficiently precise definitions to opera tionalize an evalua- 
tion activity. Consequently, to expedite this design effort, speci- 
fied elements were traced tlirough the literatiire and specific defini- 
tions developed; These were subsequently ordered into the model shown 
in Figure 1. A complete listing of included treatments, outcome areas 
and activities is sh wn in Table 1. 

Program ^oals and objectives, which served as the subsequent level of 
definition, were organized into four major categories. These were: 
(1) Place:inent; (2) Curriculum; (3)-Couriseling; and (k) Management. Each 
of these goals, and associated objectives, are listed below. 



1. Placement 
GoalT 



Develop a program which facilitates satisfactory 
placement of students' in either employment, edu- 
cation or training which permits the pursuit of a 
career choice or meets a real or perceived eco*^omic 
need. 



Objectives: 1.1. 



1.2, 



1.3. 



To insure that each ;9tudent has available to 
him or her those services which can be used 
to facilitate finding satisfaction in employ- 
ment upon leaving school 

To insure that each student has available to 
him or her those services and information 
which can be used to -facilitate makin^j a 
decision concerning further education or 
training 

To provide a service to coordinate available 
Job openings with various work programs and 
those students who desire part-time employ- 
ment 



1.^. To identify and use resources of people, 

agencies, facilities, and materials located 
within the community 



1.5* To design and implement a mechanism which 
coordinates utilization of community re- 
sources and maximizes their contribution 
to specified project needs 



2. Curriculum 



ERIC 



Goal: To facilitate integration of career education con- 

cepts into the curriculum such that each student 
majr systematically develop those skillg that eiiable 
him or her to function in the defined*llfe roles, 
including but not limited to, citizenship, family, 
economic, and avocational. 

Objectives: 2.1. To develop in each student positive attitudes 

toward career education concepts including 
tha following • constructs : 

Personal significance of productive work ' 
♦ Social significance of pi-oductive work 
Family 
Avocationfiil 
Citizenship 
Economic 

J 2.2. To insure that each student develops the 
^ knowledge base and experiential repertoire 

that would enable him or her to make a 
satisfactory career choice upon completion : 
of 'grade twelve 

2.3. To insure that each student is aware of the 
broad range of^areer options open to him 
or her in thp^^orld of work 

2. if. To provide each student with the skills 

necessary to continually re-assess career 
choice 

2.5. To i7.?sure that each student perceives his v 
or her stud ies as relevctnt to his or her 
sareer-intarests 

2.6. To insure that each student is able to 
employ the career cluster concept as the 
\mifying element of his or her school 
experience 

2.7. To insure that each student is able to 
participate in those school and/or 
community experiences which assist him 
or her in identifying and evaluating 
his or her own interf5L>ts, abilities and 

values 



Goal: 



2.8. To insure that each student has the oppor 
tunity for det€d2ed "exploration" of at 
least three career clusters of his or her 
choice 

2.9* To insure that each student is provided 

with an opportunity for in-depth explora- 
tion of at least one career cluster 

2.10. Each student will be, provided with the 

opportunity for "specialized" preparation 
in a selected career cloister 



To develop and impiement procedures that enable 
students to eoqplore and undei^stand their unique 
characteristics and how these characteristics 
relate to the defined life roles (citizenship, 
family, avocational, economic). 



Objectives: 3.1. 



3.2. 



3.3. 



3.»f. 



3.5. 



To insure that each student is able to 
acquire self -awareness of innate and 
acquired abilities, preferences and, 
potentials 

To insure that each student possesses 
the requisite skills to relate acqtiired 
self -awareness to making career decisions 

To insure that each student has available 
to him or her information about defined 
roles (citizenship, family, avocational, 
economic) 

To insure that each student has available 
to him or her the counselingj services 
necessary to make curricular choices in 
school and educational and occupational 
choices when leaving school 

To design and implement a mechanism which 
enables students to up--date, or revise, 
decisions made relative to selection of 
cluster study activities 



Management 



To develop procedures for planning/ organizing, 
coordinating, directing, and controlling staff, 
project, district, ard community resoiu'ces to 
insure the adoption of project goals within the 
district and to facilitate transportability of 
the model t ~ 
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Objectives: k.l. .To effect close, continued involvement 

of private and parochial schools in all 
aspects of project operations 

To insure comprehensive and useful - evalua- 
tion of the project- hy selection mad 
employment of a project , evaluation spe- 
cialist 

^•3- To integrate relevant aspects of existing 
special programs into a' career education 
ciarricrulum 

kmk. To maximize cooperation and coordination 
between the project and the District 
Special Education Department 

^•5- To define, for purposes of this project, 
students whose career education needs may 
be classified as "special" 

To design and implement project components 
which will satisfy idiosyncratic needs of 
students with unique learning abilities, 
physical handicaps or emotional disorders 

h.J. To establish an Advisory Council which can 
assist the project in develc^ing its use of 
community resources 

k.8» To define those roles for teachers, adiain- 
istrators and specialists which will best 
satisfy the goals of career education 

To employ a strategy of on-site visita- 
tion hy key staff for purposes of effecting 
diffusion and integration of key career 
education el3sents 

U.IO. To design and conduct necessary studies 
for purposes of identifying staff needs 
related to knowledge of career education 
and int-egration of career education con- 
cepts irto the curriculum 

^•11* To design and conduct t^ose in-service 
and/or graduate college programs which 
will satisfy identified teacher needs 
in career education 
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""^ ■EvalTle1n^ii't)Wgctlveg ~ Obtect^ 

design and implementation of this evaluation are listed below: 

1. Meastrre the extent to which stiidents who have participated in the 
project denionstrate a change in self-aweireness in grade levels 3 ^ 
6 and 9; 

2. Measure the extent to which stxidents who have participated in the 
project demonstrate a change in awareness of, and knowledge about, 
work at grade levels 3> 6 /and 9; 

3. Measure changes in career decision-making skills among project 
students at grade levels 9 through 12; 

k. Measure the extent to , which students who participated in the 
project and who left the project schools were placed in a paid 
occupation, in further education or in unpaid work that was con- 
sistent with their then current career choice at all grade levels 
by school year; / 

5. Measure the extent to which the nmber and type of job preparation 
opportunities (including work experience and cooperative work 
experience) have been expanded for young people in grades 10 
through Ik; 

6. Design a strategy to facilitate and monitor project management 
including, financial expenditures at each level of project emphasis 
(K-3;^t-6,- 7-9; 10-12; 13-1^) for the current year; 

7. Measture the extent to which students have available to them those 
services which can be used to facilitate finding employment upon 

. leaving school; 

8. Measture the axtent to which students have available to them those 
services and information which can be used to facilitate their 
making decisions relative to further education or training by 
exanuLning student use of Career Information Centers and career 
counseling services; 

9. Describe procedures employed to identify and use resources of 
people, agencies, facilities, and materials located within the 
community; 

10* /Describe procedures employed to design and implement a mechanism 

for coordinating utilization of community resources which maximizes 
their contribution to specified project needs; 

11. Describe procedures employed to insure that each student is able 
to acquire self-awareness of innate and acquired abilities, pre- 
ferences and potentials; 

12. Provide those data which will facilitate determination of which 
activities have the potential for generalization to other settings 
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table model; 



miELy' riidctiori as cbmiponeiits' of 



13* Design and conduct necessaiy studies to assess the effects of 
project staff development activities; and 

1^. Implement procedures necessary to satisfy the Guidelines for 

Evaluation of Career Education Programs', published by Development 
^ Associates, Inc., dated August 15, 197h. 

\ ' . 

Program Element Rolatior^ghi pa , The interaction between staident out- 
] come areas, project activity areas and specific objectives for both 
the project and the evaluation are shoim in the matrix included as 
Figure 1. Cell entries identify the types of activities planned by 
the project for each major outcome area. 

Shown in Table 1 is the relationship between Student Outcome Areas, 
sp,^cific project objectives and objectives for this evaluation. 
Out-ome areas not directly related to student performance are also 
included in Table 1 to facilitate data generation requirements of the 
evaluation design. 



FIGURE 1 

STUDENT OUTCOME/PROJECT ACTIVITY 
RELATIONSHIPS 



Self -Avar ene s s 


X 


X 




\~ 


X 










NA 


X 


X 




X 


Basic Skills 


X 


X 




t 








X 




NA 


X 








Work Values' 


X 


X 






X 


X 




X 


X 


NA 




X 




X 


Attitude/Work 




X 




X 


X 








X 


NA 


X 






X 


Knowledge/Work 


X 


X 


X 


X 


X 






X 


X 


NA 


X 


X 




X 


Career Decl,'sion 
Skills i 




X 


X 




X 


X 






J. 


NA 


X 


X 


X 




Work Habits 






X 


X 


X 






X 


X 


NA 






X 


y 


Obtaining 
EmDloToent 




X 


X 












X 


NA 




X 


X 






E 


JH 


SH 


E 


JH 


SH 


E 


JH 


SH 


E 


JH 


SH 


PLACEMENT 


JOB PREPARATION 


FAMILIARIZATION 
(AWARENESS) 


ORIENTATION 


EXPLORATION 


EXPERIENCE 



CO 



o 
o 

Eh 
tD 
O 

Eh 

G 
tD 
Eh 
CO 
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• ' "■' -TABLE 1'"' " " '■' 

OUTCOME AHEA, PROJECT OBJECTIVE AND 
EVALUATION OBJECTIVE RELATIONSHIPS 



j OUTCOME ABEk 


PROJECT O&HECTIVE 


pALUATION OBJECTIVE 


1 !• Self -Awareness 


?.l (C-D), 2.7 (A-B); 


1. Gr. 3,6,9 
10. Develop Self- 
1 Awareness 


II. Basic Skills 


2.2 ; 


[ 5. Gr. 10,11 1 


1 III. Awareness of 
i Work Value*? 


1-^, 1.5; 2.1 (B); 3.3 




i IV • Awareness of/ 
j Knowledge about 
1 Work 


x.H, x.;?, i^.j. vfi;; 3.3 


2. Gr. 3,6,9 


1 V« Career DecTslon" 
Making Skills 


4'7 1*^; 2.4, 2.6 

(F), 2.8 (F), 2.9 (F), 
2.10 (F); 3.2, 3.I1, 3.5(F 


3* Gr. 9-12 j 


VI. Work Habits 


2.1 (C-D-E) 




VII. Obtaining Work 


1.1 




j VIII. Placement 


1.1, l.P, 1.3, l.k 


^. Placement 1 
7. Employment 1 
Procedures j 


j IX. Continuing 
j Education 


1.3; 3.h 


8. CIC & Coun- . 
se.lor Role j 


j X. Project 
1 Management 

1 


h.i - h.ii 1 


6. Fiscal Re- 
sponsibility 
Model Gener- ( 
alizability. 
13. Staff Devel- 
opment 1 


• XI. School Use of 
1 Community 


1.^, 1.5; 2.7, 2.8 


9. Identify and 
Use Community) 
Resources j 
LO. Coordinate j 
Use of Commu- 1 
nity Resources 


XII. Unclassified 


M - h.ll (unspecified) ^ 


L4. Evaluation j 
Guideline j 
Congruence ( 
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■ PRE-DESIGN INFORMATION 

The pre-design phase of this evaluation focused upon delineation of 
project activities to be included and establishment of operational 
definitions for selected activities. This phase of the evaluation is 
designed to satisfy the published evaluation guidelines. Data and/or 
information obtained during this phase are used to complete several 
forms and/or tables specified in the guidelines. These axe included 
as Tables 2 through 6, with the OQ/TG matrix shown in Table 7. This 
latter, was developed using information presented in the preceding 
tables. 



TABLE 2 

TREATMENTS INCLUDED IN PROJECT ACTIVITIES 



- Curricular infusion - Group counseling 

- Career Day Career Exploration 

- Career Information Center - World of Construction 

staffed - Career Math 

riot staffed - Night School 

- Career education class (replaced ATS-6 demonstration) 

- Career-related materials purchased by the project 

- Use of career education curriculum guides. 

- Car*^er education materials developed by teachers 

- Job seeking/obtaining skill development 

- Test interpretation 

- Resource persons in the classroom 

- Portable career guidance center 

- Consumer Economics class (ninth grade) 

- Career exphasis in Environmental Education field trips 

- Career-related field trips 

- C.E.E.B. ^'Decisions and Outcomes" program 

- Vocational courses 

- Graphic & print materials 
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TABLE 3 • 
TREATJ-CENT SCHOOL/GRADE IdInI'IFICATION 



PROJECT SCHOOL 


PARTICIPATED IN 




C.G. 


TESTING 
GR LEVEL 


NO. OF 

CLASSES 


CE ACT 


EVAL TESTING 


■T.G. 


Collins ' 


X 


X 




Y 


J 


o 


Franklin 


X 


X 


X 




6 


5 "-. 


Longfellow 


X 


X 




X 


3 


2 


Meadow Lark 


X 


X 


X 




q - 


o 

c. 


Mountain View 


X 


X 




X 


3 


2 


Roosevelt 


X 


X 




X 


6 


2 


Russell 


X 


X 




X 


6 


1 


Valley View 


X 


X 




X 


6 


1 


East JES 


X 


X 


X. 




9 


1 


North JHS 


X 


X 


X 


X 


9 


2 


CM. Russell HS 


X 


X 


X 


X 


12 


2 


Great Falls HS 


X 


X 


X . 


X 


1 


2 



/ 
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TABLE h 



ACTIVITY TREATMENT TABLE 
(GUIDELINES IV A&B) 



ACTIVITY AREA- 


TREATMENT 


1. 


Familiarization 








1.1 Elementary 

• ] 

/ 


1.1.1 
1.1.2 

1.1.3 
1.1. If 


Curriculum • Infusion 
Career Education Field Trips 
Specialists in the Classroom 
Special Career Education Materials 




1.2 Junior High j 


1.2.1 


None 






TOT 


None 








• 






Oil 


Resource Persons 




2.2 Jitnior High 

o 


2.2.1 

2.2.2 
2.2.3 

0 0 h 


Teacher-Developed Materials from 
Career Education class 
Consvuner Economics Class 
Resource Persons 

Ti&T/PPP 






c:. J. -L 

2.3.2 

2.3.3 


leacner-ueveiopea Career Education 

Materials 

Career Math - 

Career Information Center (GFHS) 


3. 


Career Exploration 








3.1 Elementary ; 


3.1.1 


None 




3.2 Junior High 


'3.2.1 

. 3.2.2 


Teacher-Developed Materials 
"World of Construction" 




3.3 Senior High 


3.3.1 


IMC Distributed materials 
(purchased by project) 


If. 


Vork Experience 








h . 1 Elementary 


if. 1.1 


None 




k.2 Junior High 


if. 2.1 


None 
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TABLE k (continued) 



ACTIVITY TREATHI2IT TABLE 
(GDIDELINES IV A&B) 



ACTIVITY AREA 


TREATMENT , 

. . . ■ ■} ^ 




if. 3 Senior High 






None 


5. 


Placement 










5*1 Elementary 




5.1.1 


None 




5.2 Jiinior High 




5.2.1 


None 




5*3 Senior High 




5.3.1 


None 


6. 


Job Preparation 










6,1 Elementary 




6.1.1 


None 




6.? Junior High 




6.1-2 


Noae 




6.3 Senior High"\ 




6.3.1 


None - 
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• TAjILE 5A 



ACTIVITT-TREATMENTS-PARTICIPAflTS 
(GUIDELINES IV C, ELEMj'iJJTARl). 



* Outcome Areas: 
SA = Self-Awareness 
BS = Basic Skills 
WK =-Work Knowledge 
WV = Work Values 
DM = Career Decision- 
Making Skills 
WS = Work Seeking 
OS = Obtaining Skills 
P = Placement 
CE = Continued Education 



** Activity: 

F = Familiarization 
CO = Career Orientation 
CE = Career Exploration 
WE = Work Experience 
P = Placement 
J = Job Preparation 



OUTCOME 
AREA* 



ACTIVITY** 



TREATf-IENTS 



PARTICIPANTS 



SA 
SA 
SA 
SA 
WK 
WK 



WK 
WK 

ALL' 



,F 
F 
F 
F 

F/CO 
CO 



CO 

CO 
ALL 



. Most Important Person 
Curriculum Infusion 
Use of DUSO Kit (l) 
Use of DUSO Kit (2) 
RGsource Persons 
Field Trips 



Career Corners/Library 
Curriculum Infusion 
Special Materials 



All K 

All schools • 

All schools 

All schools 

All schools 

Lewis & Clark 

Russell Elem 

Longfellow . 

Lincoln 

Riverview 

Collins 

Morningside 

Franklin 

Roosevelt 

Sunnyside 

•Lincoln, Gr 6 

Le\dB & Clark, Gr 3 

ALL 
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TABLE 5B 

ACTIVITY-TREATMENT-PARTICIPANTS 
(X}UIDELINES IV C; JUNIOR HIGH) 



• AREA* 


ACTIVITY** 


TREATMENTS 


PARTICIPANTS 


OA 


rn 




JMortin, Cir y • 


BS 


CO 


Portable Career 
information Center 


West, Grs 7, 8, 9 


WK. 


CE 


"World of Construction" . 


.:East, Gr 9, 1 class 


WK 


F/CO 


Resource Persons/ 
Classroom 


Selected groups 
Grs 7, 8, 9 


TABLE 5C 

ACTIVITY-TREATMENT-PARTICIPANTS 
(GUIDELINES IV C; SECONDARY) 


OUTCOME 
AREA* 


ACTIVITY** 


TREATMENT 


PARTICIPANTS 


DM 


CO 


CEEB/Decisions & 
Outcomes 


CMR, Gr 12 Bronson 


BS 


CO/CE 


Career Education 
Library tinit . 


CMR, All Gr 10 


WK 

WS/OS 


CO/J 


Resource Persons/ 
Classroom 


Selected groups 
GFHS/CMR Grs 10, 11, 12 


WK 
CE 


CO/CE 


Established ^CIC 

Staffed Career Infor- ' 

mation Center . 


CMR, Grs 10, 11, 12 
GFHS, Grs 10, 11, 12 


vTK 


CE ■ 


Career Exploration 


CMR, Grs 11, 12 Kercher " 


WK 


F 

CO 

CE 


Special Material 
(Project purchased) 


K-12 Selected group 


WK 


TP 

CO 
CE 


Special Material 
(Teacher-Developed) 


K-12 selected group 


WK 


J/P • 


Voc-Ed Courses 


Selected Grs 10, 11, 12 

HS 
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PARTICIPANT-TREATMENT GROUP 
(GUIDELINES I7-D) 

\ • 



OA* 


ACT** 


LEVEL 


TREATMENTS 


PARTICIPANTS 


TREATMENT GROUPS 


SA 


F 


EL' 


"Most Important 
Person" 


All Schools 




SA 


F 


el' 


CurriculiHD Infusion 


All Schools 




SA 


f' 


EL 


DUSO Kit 1 
DUSO Kit 2 












Special Materials": 






WK 


F/'CO 


EL 
JH 

SH 


a) Project purchase 


K-6 students 


• 


1 


f 


EL 

JH 
SH 


b) Teacher- 
developed 


K— 6 classrooms 

7-9 classrooms 
10-12 classes 


0 


WK 


F/CO 


EL 


Resource Persons 


All K-6 




WK' 


F/CO 


JH j 


Resource Persons 


All 7-9, 




WK 


CO/J 


SH 


Resource Persons 


All 10-12 




WK 


CE 


JH 


"World of 
Construction" 


Gr 9 East 


Mikulecky class 1 


DM 


CO 


SH 


CEEB/Decisions & 
Outcomes 


Gr 10 GFHS 

Gr 12 CMR ] 


Bronson classes 2 


BS 


» J 


SH 


Career Math 


Gr 10-12 GFHS i 


Special group 


WK 


CE 


SH 


Career Exploration ( 


jts 11-12 8fHS I 


Cercher class 








Field Trips: 






WK 


CO 


^ 1 

SH j 


a) Career and Envi- ( 
ronmental Educ.; t 
Studio Art C 


jt k-6 all p 
schools 

\r 11-12 CMR K 


111 Schools 
'ercher class j 
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TABLE 6 Ccontinued) 

PARTICIPANT-TREATMENT GROUP 
(GUIDELINES IV-D) 





ACT»» 


LEVEL 


TREATMENTS 


PARTICIPANTS 


TREATMENT GRO^JPS 


• 

VX 
WK 
WK 


CO 
CO/CE 
GO/CE 

CO/CE 


EL 
SH 
SH 

SH 


Library Study: 

a) S-l,ud/ Corner 

CE Library Unit 
^ Established CIC 

q) Staffed CIC 


Gr K-6 Lincoln 
Gr 10 CMR 
Gr 10-12 Zm 

Gr 10-12 Gi ii3 


Stiidents who use 
Center 

Students who use 
Center 


SA 


CO 


JH 


DAT/CPP 


Or 8-9 Paris, 

Mor uxi 






F/CO 


EL 


Ciirriculuffl Infusion 


All Schools 




WK 


J/P 


SH 


Voc Ed coiirses 1 
« 


Gr 10-12 GFHS, 
CMR 


Stxidents electing 
Agribusiness 1 
Food Services & ^ 
Child Care 


BS 


CO 


JH 


Constauor Econonica 


Gr 9 aH 


All Gr 9 


WK 


CE/CO 




Portable CIC 


Gr 7-9 West ' 
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TABLE 7 

OUTCOME QUESTION/TREATMENT GROUP 
MATRIX 



OIITCOME 
QUESTIONS 



TREATMENT 
GROUP 



I. Increased Self -Awareness 

A. Describe abilities & 
H ml Nations (ao test) 

B. Describe interests 4 



III, 



values (no test) 

C. Positive attitude toward 
self 



D. Recognize forces in- 
fluencing development 



II. Increased Academic/Vocational 
Skills 

A» Numerical skills (dis- 

trlct teat) 
B. CGnmmnications skills 



(district t0fft) 



C. Information processing 
skills (no test) 



D. Decisions-making skills 

(no test) 

£. Inter j^ersoaal skills 



(no test) 



Awareness of Work Values 
A* Baals of work values 



B. Desire ' for paid/impaid 
work 



IV. Awareness/Knowledge of Work 
A. Duties and reoulreiEi^nts 



B. AsBociatad life styles 

C. Entry requirements 



X 



X X 



X 



X 



XXX 



o 



X 



X 



X 



X 



X 



X 



1 z 



_ o 



o 
C3 O 



X 



X 



X X X X 



o 

g 
o 



X 



aEiil[l[l!l!lLl[i3L]H|Li 
aaEiElE9iia»lLlLl!lyl3 



Impact of social/tach- 
noloffical chance 


X 


X 


X 


X 


X 


3? 


X 


I 


X 


X 


X 


r 

be, 


X 


Factoi. affecti^ng 
succei^s/satisfaction 


X 


X 


Xi 


y 


X 


X 


X 


X 


x] 


X 


X 


X 


3? 


>er Daci^ion^MAVing 5?V4nw 
Interests, abilltiecs/ 
future success 
















X 


X 


X 


X 


X 


X 


Interests, abilities/^ 
life styles 


















X 


X 


X 


X 


X 
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TABLE 7 (continued) 

OUTCOME QOESTIONATIEATMENT GROUP 
MATRIX 



TREATMENT 
GROUP 



OUTCOME 
QUESTIONS 



IV. 



VII, 



Utilize sources of 
Information 



Potential for advancement 
(no test) 



Career planning 



C. 
D. 
E. 

F. 

Improved Work Habits 
A. Plan work effectively 

(no test) 
B» Adapt to varied situa- 
tlons (no test) 



c 

f 



Active Involvement 



C, 



E. 



F. 



Attitude toward quality 
in work (no test) ^ 



Conservation of 
resources (no teat) 



Personal responaibility 
(no test) 



Desire for continuous 
lei^mlng (no test) 



Work Seeking/Ge^fitirg Skills 

A. Sources of information 

B. Applying f oi'/accepting 



VIII . Placement 



work (no test) 



B. 



D. 



Further education 
(no test) 



Paid occupations 
(no test) 



"II. 



Consistent with career 
plfms (no test) 
Unpaid work (no test) 



Means of Continued Education 

A. Identify sources 
(no test) 

B. Identify support 



(no test) 



o 

•s 



0> r 



u 



u 
a 



1 



X 



X 



X.X 

x" 
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SECTION III 



DESIGN SPECIFICATIONS 

IntrQducti r>nJ Tvro strategies have been used to develop specifications 
for the. evaluation of each objective. To satisfy the evaluation 
guidelines 9 quasi-experimental procedures have been employed where: 
(a) appropriate criterion tests were available} (b) treatment and 
comparison groups could be deliniated and maxiipulatedj and (c) data ^ 
generated could satisfy assumptions necessary to achieve desired 
levels of statistical rigor. 

Where these criteria dould be satisfied, the design specifications 
include hypotheses to be tested, a design configuration, description 
of treatment employed, aampliJig procedxires (where appropriate), and 
statistical tests to be employed. In all cases, only statistics which 
would Contribute to an understanding of the treatment effects \^ere ^ 
used. For example, in those situations where the same subjects were 
administered the same meastxre twice, a treatment by subjects design 
would have been most* appropriate. However, the t~test for related 
measures has been employed as it sd,5Dplified the presentation, and 
presumably, understanding, of the analysis. 

Project objectives which did not require the use of treatment a^d con- 
trol (comparison) groups were detailed throxsgh use of an evaluation 
design worksheet. These are different from those, "used In the guide- 
lines in that a complete evaluation for an objective is described on 
a given form. 

Objective Specif 1- : i ms . Specifications for each project objective 
included in the evaxuation are presented in the following pages. 
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Objective 1 : Measure the extent to which students who have parti ci- ' 
pated in the project demonstrate a change in self- 
awareness in ^ade levels 3, 6 and 9. 

Hypothesis: There will bo a change in student self ^awareness a6 a 
result of project participation. 

Sample : 



Grade 


School 


Class 


n= 


3 (k) 


Franklin 






25 


6 


Franklin 






P5 


9 


North JHS 

PariE Gibson JEIS (Tp) 




60 



Design: 



Level 


Obs j Treatment 


T 

n= 


Criterion Measure 


Analysis 




Post 
only 


BCCI 


25 


s.o.s. 

(spring 1975) 




6 


Post 
only 


BCCI 


25 


s.o.s, 

(spring 1975) 




9 


Pre 
Post 


DAT/CPP 


60 


Self-Report 

on Abilities 

(p. A29 - 1975 report) 


t 



= 197h-75 classes (baseline) 



= 1975-76 classes 
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Objective 2; Measure the extent to which students who have partici- 
pated in the project demonstrate a change in awareness 
of, and knowledge abcyt, work at grade levels 3, 6 and 
9» 

Hypothesis: Project participation, will result in a change of know- 
ledge about, and awareness of, work. 



Sample: 





wJTVJ up 


School 


oXass 


n 


3 


Treatment 


MoiintAin Vi «i/ 








II 


Longfellow 


W. Blacquiere 


27 




II 


Meadow Lark 


M. Mitchell 


21 


3 


Comparison 


Valley View 


S. Hope 


27 




II 


Collins 


P. Linaberry 


17 


6 


Tr^^rdtmont 


Franklin 


C. Adlophaon 


23 




II 


Meadow Lark 


T. Stevens 


21+ 






Russell 


M. Baumann 


27 


6 


Comparison 


Franklin ' 


G . Stepman 


21+ 




II 


Riverview 


K, Laveson 


28 




II 


Roosevelt 


P. Senn 


21+ 


9 


Selected 


East^^JHS 








Students 


B. Church 


11 



Design: 



, Level 


Group C^. 


Treatment 


-Design 


Criterion 
Measure 


Analysis 


3 


^1 


Curriculum 

Infusion^i^ 
None 


pre-'post 
pre-post 


ceqQ) 

CEQ 


/ V2 
^2 


6 


^1 
^2 


Curriculum 
Infusion 
None 


pre-post 
pre-post 


OECQ® 
CBCQ 


T T 

^1^2 

^2 




^3 


C,E, Class® 


pre-poat 


CMl(D 


*3 



Curriculum Infusion defined as a teacher who has completed 
the career education in-service training program. 
A special class -being conducted this f^^y:. A diary/log of 
the class will be kept for descriptiv.> pu.rposes. 

Career Ediic»t ion <^ieBtlbm mlre-^^ .-.. rr^r^-:^:^- 

Career Education Cognitive Questionnaire 
Career Maturity Inyentory 

Tj^=trained teacher; T2=non- trained teacher; T^= regular 

1 13 
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Notes: 1. 

2. 

k. 
5. 
6. 



jectlve Measure changes in career decision-making skills among 
project students at grade levels 9-12. 



Hypothesis: Project participation will have no significant effect 
upon students career decision-making ability. 



Sample: 










Grade 


j Group 


School 


Class 


n 


9 


Treatment (T^^) 


(5 wk Consumer Econ 

class) 
North JHS 




on 




Treatment 


(Career Education 

class ) 
East JHS 


Church 


11 


12 


Treatment 


Great Falls HS 


Bronson 


27 




Comparison 


Great Falls HS 


Random Sample 


25 


9 


Comparison (Tg) 


North JHS 


Random Sample 


25 




Comparison 


East JHS 


Random, ^mple 


25 



Design: 



Level 


GroupO 


Treatment 


Design 


Criterion 
Measure 


Analysis 


12 


^1 . 


CEEB Decisions* 


Pre-post 


CDI 


*T T 






& Outcomes 




^1^2 






(Bronson) 












None 


Post only 


CDI' 




9 




Career Education 
Class (Church) 

Career Education 
in Cons. Econ 
Class (Larson) 

None (use "pre" 
group from 
1975 on cm/ 
ATS-6; see 
1975 report, 
P- 36-37) 


Pre-post 
Post only 


CMI 
CMI 


*T T 



Notes: 1. T^=:treatment group; Tp^comparison group 
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Ob.ieetlve k : Survey work-experience prograja students to determine 
how present job relates to perceived career goals. 

Hypothe.«3is: There will be no discrepancy between students career 
goals and their placement through the Great Falls 
work experience program. 

Seunple: All students who participated in the work experience 

program between October 1, 1975 and April 1, 1976. 

Design: 

A. Data required: 

1. Description of work experience program, including: 

a. procedures for identifying work stations; 

b. procedures for recruiting work stations j 

c. criteria for selection of students for program; 

d. criteria for placing students; and 

e. outcomes sought as a result of placement in a 
work experience site. 

2. Inventory of all available work experience sites; 

3. Li3t of vork experience stdtions (sites) used; 

h. List of ell students who were placed in a work 
experience site; 

5. Responses to questionnaire from all students in-' 
eluded in the sample, 

B. Instrumentation: questionnaire, locally developed, 

C. Analysis: 

1. Program description; 

2. Participant d-jmography (description); • 

3. Congruence between goals and placement (description) 

Student perceptions of benefits derived from work 
experience program. 
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EVALUATION DESIGN VORKSHEiST ■ 
mHIATION OBJECTIVE: (5 - Describe the degree of expansion of job preparation opportupities (vocatiODal 
education, work experience, cooperative work) in grades lO-li 



INFOMTION REQI 


JIRED , 


DATA COLLECTION 


DATA ANALYSIS 


DATA REPORTING 


Informatior. 


Source 


uoaervaiion/ 
^(easure 


Schedule 


Reduction 


Analysis 


When 


To 


By 

Whom 


1. Vocational Edu- 
cation cours»3s Ih-l') 


Voc-Fd Tchr 


Record 


6/1/76 


List 




final 


J 




2. Students partici- 
pating in work exp. 


Proj Staff 


Record 


m 


List ■ 


Distr Sta. 
X students 


final 






3. Number coop work 
stations avail/used 


Proj Staff 


Record 


i/m 


'List 


Distr Sta. 
X stu X use 








^. Changes in coop/ 
work stations 


Proj Staff 


Record 


5A5/75 ; 


List ■ 


Sig'nce of 
differences 

mm 


final 






5. Description' of 
procedure used to 
identify coop work 
stations 


V/Exp Coord 


Questionnaire ' 




Descr. 


final 






,6. Description of 
total coop and work 
.experience program 
for grades ?-12 


Proj Staff 


Qiiest/Interviev 


6/V76 


Descr, 


mm 


final 







lift 

ERiC ' 



I 



MLUATION DESIGN VORKSIRT 

mLUATIOK OBJECTIVE:' ft - continued 



iNFOHMATIOflREQl 


IIR2D 


DATA COLLECTION 


DATA ANALISIS 


DATA REPORTING ' 


Information 


Source 


Observation/ 
Measure 


Schedule 


Reduction 


' Analysis 


When 


Whgm 


Whom 


7. Project use of 
coniunity resources 
in establishment of 
coop work stations 

8. Number of stu- 
dents in work 
release program 

9. Voc Ed & project 
staff liaison for: 

a. Course 
Development 

b. Prograia 
Articulation 

c. Prograi 
Development 

8 I 


Proj Staff 
Proj Staff 

Direcxor 
Director 
Director 

* 


Quest/Interviev 
Record 

ljuestionnaire 
Questionnaire . 
Questionnaire 

i 


6/1/76 

5/15/76 . 
5/15/76 

5/15/76 


Descr. 

Descr. 
Descr.. 
Descr. 


4*M 


final' 

W 
final 
final 




'i 



lis 
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Objective 6: Monitor financial expendit\^es at each level of emphasis. 



PROJECT BUDGET REPORTS 



EXPENDITDRES 


LEVEL OF EMPHASIS 


TOTAL 




7-12 


7-9 


10-12 


K-12 


Personnel 














Professional Salaries 














Clerical Salaries 














Employee Benefits 














Travel 














Supplies & Materials 










* 




ConLnimi ca ti ons 














Services 














Equipment 














TOTALS 








i 
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Objective Measiire the extent to which students have available to 
them those services wiiich can be used to facilitate, 

their finding employment upon leaving school. 

\ 

Design: 1. Describe all placer ont services available to students; 

' . *» 

2. Administer questionnaire to working students who have 
left school to identify availability and usefulness 
of placement sei*vices, v. 

Data Required: < ;v 

Required: 1, List of placement services available, including: 

a. name.; 

b. location (address); ; 
< c. services offered; 

d. fees charged.; 

e. affiliation (government agency); 

f . hours of operation; , . . 

2. Working students (ri=30) to complete locally deve loped S 
questionnaire . v ' 

Analysis: 1, Frequency of student use of each service available; 

2. Description/of student perceptions of: 

a. adequacy of number, of services available; 

b. usefiilness of . services employed; 

' c. adequacy of service availability; 

d. general satisfaction with placbment program;. 

3* Description»of students who used placement services; 

... and . . 

Description of placement services available to 
students. 
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mUATION DESIGN mSHEET 

t ... 

MATIOli OBJECTP/E; . ir8 - Exmne stdents' use of Career Information Center to facilitate Baking 



career decisions. 



IIIFOMTIOII HEQUIHSD 



DATA COaSCTION 



DATA 0EISIS 



DATA HEPORTING 



Information 



Source 



Ob3er7s;tion/ 
l^easure 



Schedule- 



Reduction 



Analysis 



When 



To 



To 

Whom 



12^ o 

ERIC 



Description of: 
a". CIC content 
b. Procedure 
for student 
use of CIC' 
t, Frequency of 
counselof 
referral to 
CIC 

d. Student per 
ception of 
CIC value 
in career 
decislon- 



2. Frequency of 
student use of 
CIC 

a. Grade x 
career choicj 
X sex 



CIC Dir. 



CIC Dir. 



Counselor 



Gr 11-12 

students 



students - 
who use CIC 



Records 



Questionnaire, 



Questionnaire 
page 1^7 



Questionnaire 



6/l/7« 



m 



Questionnaire- 



Categories 



Description 



final 



final 



Di???.cription 



Description 



FVequency 
Distribution 



final 



final 



final 



MATM DESIGN msiET 

E\»7I0;i of; ^8 > continued 

V 







IRSD ^ 


DATA COLLECTION 


MTA MAIISIS 


DATA REPORTING. 


Information 


Source 


Observation/ 
— J'feagure- — 


Schedule 


Reduction 


Analysis 


Vhen 


To 

-4IhoB- 


To 
Jho^- 


-J 

1 

121 


b. Dufi to.^oun- 
•Hfflorpef^ 
ral 

. c» Epe^/indi- 

referral 

3. Description of 
caterials usage 
(frequency of us€ 

h. Effects of CIC 
. use on: 

a. Finding a jol 

b. Career deci- 
sion 


students vho 
use CIC 
students vho 
use CIC 
students who 
use CIC , 

CIC Dir. . 

) 

students whc 
use CIC 
students who 
use CIC 


Questionnaire 
Questionnaire 
Questionnaire 

Records 

Questionnaire 
Questionnaire 


* 

6/15/76 
6/15/76 
6/15/16 

6/1A6 

6/15/76 
6A5/76 


Frequency 

Distribution 

Frequency 

Distribution 

Frequency 

Distribution 

Frequency 
Distribution 

Frequenc/^^ 

Frequency^^^ 
^ 'no 


Correlation 
vith referr 
and uitb ■ 
usage 


final 
final 
final 

finaV 

final 
final 


4 


c 
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EVALUATION OBJECTIVE: ' f9 - Describe procedures -employed' to. identify and m regources from the 



■comnunity; and §10 - Describe procedures used to facilitate use of the CofflBunity Resource Center. 



BIFOmiOII REQUIREB 



DATA COUECTION 



DATA ANALYSIS 



vDATA REPORTING 



Information 



Source 



Observation/ 
Measure 



Schedule 



Reduction 



Analysis 



Iften 



To 

Whom 



,To. 
Whom 



1. Frequency of 
requests at • 
CRC • CRC 

2. List of coQHiunity 
resources 
inventoried CRC 



3. Description of 
procedures used 
to add resources 

i Estory/back- 
ground of CRC 

5. Types of re- 
sources inven- 
toried 

6. Services pro- 
vided by CRC to 
effect use of 



Proj Staff 
ProJ. Staff 



CRC Staff 



CRC Staff 



Records 



.5/15/76 



Records 



Interest 
Questionnaire 

Interest 
'Questionnaire 



Records 



Questionnaire 



5/15/76 



6/1/76 



6/1/76 



5/15/76 



5/15/76 



Basic Questions: 1. Hov are coniunity resources located? 
'3' Row do people get then? 



List 



Avail X 
Reouests 



final 



List 



final 



Description 



NA 



NA 



final 



final 



Categories 



List 



final 



final 



2. Vhat is available? 
K How often are they used? 
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DESIGN SUMtlARIES 

Introduction, The" Guidelines for Evaluation of Career Education pro-, 
grams, prepared by Development Associates, Inc., emphasize three 
qTiestions that should be cmswered in any "treatment-outcome" evalua- 
tion.* These are: 

1. How do the experiences (treatments) for treatment' and com- 
—par-ison-groups-differ? — 

2. How do the outcomes (products) for treatment and comparison 
groups differ? 

3- How do treatments relate to student outcomes (when there 
are outcome' differences between treatment and comparison 
students)? ' 

The design strategy proposed by the Gxiid^lines uses these types of 
questions as the basis for a decision structure to be used by both the 
project and the evaluation. In accord with the strategy, one question 
of each type (Outcome, Treatment, Relational) should be formilated for 
each outcome area-treatment addressed by the project. 

In this project, it has proven more feasible to cluster these questions 
by treatment groups, rather than outcome areas, since several treatment 
groups are included in a given outcome area. This procedure has. en- 
hanced the "summary" intent of the worksheets. ^ 

It should also be noted that these fcjummaries focus only upon student 
outcome areas while project objectives focus upon: (-1) student out- 
comes J (2) related project activities (to insure attainment of desired 
student' outcomes; and (3) project management. Design summaries, be- 
cause of their constricted focus, hare been prepared only for the first 
category/type of objective. 

Design summaries for each treatment group used, in each outcome area, 
are presented on the following pages. 



* Draft Guidelines for Evaloiation of Career Education Programs > 
Development Associates, Inc.; Washington, D.C., August 15, 197^; 
p. 51. 
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- ' ; ^ raUATION DESIGN SUMHIRI ^ 

Treatment Group(s): Grades 3 and 6, Franklin 



• Treatment:; B.C. C.I, 





-Outcome- 






— Data- 


■ -Criterion- 










Area ; 


Evaluation Questions. 


Design 


Source 


Instrument 


Sample • 


Analysis 






1. Self- 


Outcome (I-A) 
















Avareness 


Have students Increased their 
ability 'to describe their own 
abilities and Mtations? 


Pre-post 


B.C.C.I. 


s.o.s. ■ 


Randomly selected 
classes, n=30 


Fj treatmenti 
by subjects 
design 


• 


0 




r, 

Treatment 










^ 






A. How many hours were spent in 
adiinistraton of the B.C.G.I.?' 


Record 
of hours 


Teacher 


Log 

* 


sai&e as above 


ilrequency 
)istribution 








B. How many hours were spent in 
use of B.C.C.I. data? 


Record 
of hours 


Teacher 


Log 

■ 


same as above 


iame as above 








Relational . 


0 
















A. Vhat relationship exists 
between hours of use of B.C.C.I. 
data and student performance on 
the S.O.S.? 


Correla- 
tion 

,r 

T 


Records 




same as above 

* 


3orrelation 
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METION DESIGN SDMKI 
Treateent Group (s): Grade % Parle Gibson and North Junior High Schools 
Ireatnent: D.A.T, idth Career Planniajj! Prograa 





Outcons 
ilrea 


Muation Questions 


Design,. 


Data- 
Source 


Criterion 
Instrument 


Sample 


Analysis 






I. Self- 


Outcome I-A) 
















(ivareness 


A. Is there any increase In 
students' ability to describe . 
their own abilities and linl- 
tatlons? 


Pre-poflt 


Gr 9 

students 


Self-reporl 
of 

abiHties 


Handonly selected 
intact class 


I^eatoents 
jy subject 




'-...IS 

1 ' ' ' • 


4 

•It. 


i!f&ifl^."|ro^g) sessions were 
;3*M-:t5' 'Interpret the D^ 

B. Hov many , individual sessions 
for each student? 


■ 


Etecord 
Record 


"Log 

Log ■ 


same as aboTe 
sane as above ' 


frequency 
Distribution 

Frequency 
Distribution 




- ♦ 

4 


t 

u 


Relational 

A. Vhat is the relationship 
betveen hours of counseli^ 
using DAT/CFF data bases and 
self-report of student abllltiesi 










Correlation 
M 
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^ raUATIONDMSIMBI 

r 

' Treatment Groupjs): Grades 3 and 6, Mountain View, Longfellow, Meadow Lark 
Treatment: Curriculum Infusion ' 





Outcome 
Area 


I. 

Evaluation Questions 


Design, 


Data 
_iourcfl . 


4 

Criterion 
Instrument.. 


Sample 


Analysis 




( 

1 












— i— 






IV. Aware 
ness of 
and Enow- 
ledge 
About ' 
M 


■Outcome (I-A) 

Has there been a change in stu- 
dent awareness, of, and knomedge 
about, M? V 

;■ 

\ 

■ i ' . 


Pre-post 

Frequen- 
cy of 
use of 
C.E. • 
methods 

Correla- 
tion 


Student 
test 

/ 

p 

t "C 

Tr. 

Teachers 
Record , 


C.E.Q. 

Quest. 
NA 


Classes of 3 
teachers trained 
in C.E. and 3 
teachers not so 
trained. ^ 

1 

1 

/ ■ ■ . 

same as above 
same as above 


1. Treat- 
ments by 
subjects for 
treatment' 
groups 

2. t^for^ 

treatments- 
comparison 
group post- 
test scores 

1, 

Correlation 

H 


To what extent doieachers who 
have completed a G.i course use 
C.E. methods more than teachers 
who have not? 


Vhat relationship exists betvesn 
ftequency of use of C.E, methods 
and student awareness of, and 
knowledge about, work? / 
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EVAIUATIOH DESIGN SUNMARI 



TmtiBentCroup(3)j Grade 9t East Junior High School 



TreatoflBt! Special Career Education Course 



ness of 
and Koov* 



135 



Outcooe 
Area 



Evaluation Questions 



IV. Aware iCutcoiiie (A-E) 



Has there been a diange In studen' 
avarenesB of, and knovledge about 
vorJi?' ' ' ' ' 



Pre»poB 




''ffiiitk course strategies 
ipeik 'to' tba ontcooe desired? To 
vbit^nthaTs these strategies 
been validated? 

Vbat is the relationship betveen 
successful coipletion of the 
course and an increase In the 
specified outcoae area? 



Bate 
Source 



Student 
test 



Record 



Criterion 
Instnient 



CM.L 



NA 



Sanple 



Intact cU^s 



treataents 
subjects 



sane as above 



saBe as above 



Analysis 



AKGOVA 
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■ EVALUATION DESIGN SIMI 
Treatnent Group (s); Grade 12, Great Falls High School 



Treatnent: C.E.E>B.; Deolslons & Outcosies 



OutcoBe 
Area 



Evaluation Questions 



Data 
Source 



Criterion 
Instnient 



Sanple 



Analpis 



y. In- 
crease in 
career 
Deciaion- 
Kaking 
sklllB 



Qutcone (A, B. P) 



ERIC 



Rave students increased in their 
ability to use infonation about 
thensehea and ocdipationa in 
naking career decisions? 

Treatment 



Pre-poet; Student 
Conpari- 



C.D.I. 



2 classeB at GFHS 



teat 



son 



Hov many hours vere directed to 
uae of the C.E.E.B, materials?. 
Vera, they used as prescribed? 



Vhit relationship exists betveen 
hours spent in use of the C.E.E,6 
iateri.al8 and an increase in 
student career decision-Dakisg 
abiUty? 



Tally of 
hours of 
use; 
Intenlei 



Teacher 



Log; Quest. 



NA 



t^ for post- 
tests 

treatnents 
by subjects 



Description 



Record 



NA 



Correlation 

(f) 



raiJATioN DESIGN mm , ' 

TreatfflentGroup(s): Grade 9. North and Eagt Junior Hl£h Schoola. Course In Conauner Ecot^ffm^t^f 
Treatnent: A special Careei' Education unit nested within the courae 





Outcooe 
Area 


Bvaliiiation Questions 


Design 


Data 
Source 


Criterion " 
Instrument 


Sample 


Anal/sis 




V, In- 


Outcome Lm) ' 














crease 

career 

daclalon- 

Baking 

BkiUa 


Have students Increased in their 
ability to use Information about 
theuBfllves and occupations In 
making career decisions? 


Pre-post 
Dost ojHi 


Student 
test 


C.M.I. . 


2 selected classes 


treatments 
Dy suDjects 
tj^ for post 

tests 






Treatment 
















To vhat extent has the special 
unit been validated? In vhat 
specific context vas it used? 
Vhat special materials are 
acquired? 

Keiatioiia^ 


NA 


Teacher 
InterTiev 


Quest. 


RA 


Description 


't 




Vhat relationship exists betveen 
student coopletion of the C.E. 
unit and incrdasditl career 
decision-making capability? 


NA 


Record 


NA :, 


HA 


Correlation 
(t) 


1 
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SECTION V 

^ DATA COLLECTION 

Introduction, Three types of data will contribute to this evaluation. 
They are: (1) standardized and/or recommended tests; (2) questionnaires 
and (3) selected elements of record data. Specific strategies for use 
of each data generation method are described below. The schedxae for 
data collection and euialysis was described in the design specifications 

Standardized Tests. Tests ^.o be employed for this evaluation are 
listed below: 

\ 
\ 

\ 

\ 

\ 

\ 



TESTS EMPLOYED 



TEST 


Evaluation 
Objective 


Outcome 
Area 


Grade 
Level 


• 

Self Observation Scales 


1 




3 & 6 


Career Education Questionnaire 


,..2..-..,.—, 


IV 


3 


Career Education Cognitive Questionnaire ' 


2 


\ 

IV, 


6 


Career Maturity Inventory 


2 


IV '\ 


<) 


Career Ddvelopment Inventory 


3 




12 


Differential Aptitude Test/CPP ' 


1 


'T 

± . 


9 


Barclay Classroom Climate Inventory 


1 


N/A 


3 & 6 



141 

36 



Questionnaires . Several questionnaires are necessary to obtain infor- 
mation and/or data required to satisfy the design specifications. 
Questionnaires to be employed, and the purpose for their use, are de- 
scribed below. ; / 



QUESTIOMAIRES EMPLOYED FOR THE mLUATION 



Respondent (s ) 


Eval. 
Obi . 


Purpose/Focus 


Work Experience Students 


k 


1 

To determine the degree of 

job and p'jrceived career 
goals 


Co-op Work Coordinators 


5 


Identify the extent to which 

preparation opportunities have 
been expanded 


Students NOT enrolled in 
Co-op or work experience 
programs 

\ 


7 


Identify the extent to which 
students find' available ■ 
placement service of value 
and the extent to which each 
...type^available is used 


Students who ug6 the Career 
Information Center 


8 


Perceptions of Career Infor- - 
mation Center value in career 
decision processes 


Caxoer Information Center^ 
Director / 


8 


Inventory of Career Infoiia- 
tion Center resources; proce- 
dures for student use of 
Career Information Center 


Teachers who have taken a 
Career Education course 


13 


Determine the extent to which 
the use of Career Education 
strategies is retained 
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Record Data. These types of data are those which do riot require 

special- instrumentation other than a recording format. They 

are routinely generated during the course of developmental projects. 

A complete listing of record data for this evaluation if presented 

below: 



RECORD DATA WHICH CONTRIBUTED TO THE EVALUATION 



Eval. 
Ob.1 . 


Son T^n P 


Description 


k 

i 


staff 


— DescriistioTi of* uoT*lf pv^ot^t^tioo T^^rt*T^rtT« 
-Inventory of available flrork experience sites 

- List of work experience stations used 

" Listing of Studsnt^ nlnr^Pfil 4n T-Tn7*lr pYT%A^4AnnA > 

*o fc» wiAVA^i* ^judccju d.ii wux^A experience 


5 


Staff 


- Number of job sites available for work experi- 
ence and cooperative work programs 

- Description of vocational education courses 
available 

- Number of iob ces user) foT tJOT»lr pvtiot^tpti/^o 
and cooperative work programs, 1975-76 

- Inventory of Community Resoiorce Center materials 


6 


Project 
Director 


- Financial report for 1975-76 




Staff 


'III. ^ 
- List and description of placement services 
available to Subjects (present and former) 


8 


Staff 


- Inventory of Career Information Center materials 

- Total hours of student CIC use 


9 


Center 
Staff 


- Number of requests for service received at the 
Community Resource Center 

- List of community resources inventoried 

- Description of procedure for teacher use of 
community resources 


12 


District 
Staff 


^- Description of each of the following project- 
developed components: CIC, CRC, in-service 
training course, coiinselor roles, curriculum 
units, special materials development proce- 
dure, work programs, and placement programs 

— I /'^ ' 



143 

38-, •. 



SECTION VI 



REPORTING 

Audiences , Two primary audiences xfill be served by this evaluation, 
project staff and the project sponsor. Information provided project 
staff will be oriented toward facilitating qualitative improvements 
in operational decision processes. Information provided the project 
sponsor will focus upon: (l) identification of model cQmpohents which 
can generalize to other settings; and (2) description of the effects 
''of specified treatments. 

Reports . Quarterly accomplishment reports will be filed which de- 
scribe: (1) work completed; (2) work to be completed in the next 
quarter; (3) problems encountered; and (k) congruence of work accom- 
plished and proposed schedule. 

A final report will, be published upon completion of the evalxiation, 
generally following the outline shown below: ' 

FINAL EVALUATION REPORT 

TABLE OF CONTENTS 

Section Page 

I. Summary 

II. Evaluation Procedures 

^ a. Purpose - I 



. b. Data Generation 

c. Design Summary 

1. Outcome Question/Treatment 
Group Matrix 

2. Objective Specifications . 
III. Report of Evaluation Data' 

IV. Conclusions and Recommendations . . , 
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EXEMPLARY PROJECT IN CAREER EDUCAriON 



Great Falls Public SchcxDls 
Great Falls / Montema 
1974 

Evaluation Questionnaire 

Counselors 
Form I 



Personal Information 
1. Your age: 



a 
□ 
□ 
a 



21 - 25 
26 - 30 
31 - 35 
36 - 40 



Your sex: 

I i . Female . 

- Yearn in fireAt_.Eallaj 



a 



1-3 
4-6 
7-9 



4. Marital status: 
• Q ■ Single 
Q Married 
I [ Divorced 
I [ Separated 



Q 41 - 45 
Q - 50 

n 51 - Over 



Q Male 



Q 10 - 12 
□ 13 - Over 



-1- 
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Professional Iiformation 



5, Which of the following best describes your present level of 
college training in terras of degree (s) and quarter hours? 



a 


BA 


+ 


15 


hours 


a 


BA 


+ 


30 


hours 


ET 


MA 










J«A 


+ 


15 


hours 


a 


MA 


+ 


30 


hours 


□ 


MA 


+ 


45 


hou±s 


□ 


Doctorate 



6. Please list the last four positions you have held in education. 



Position 


yeaurs 
Held 


Nature of Work 
























1 



7- Major professional goals: 

(a) ■ • 



(b) 



(c) 



8. Are you aware of the Career Education Project currently opera 
tional within the district? 

0 yes 

LI No 
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. How do you — in yotir own work or for your own purposes — define 
"Career Education" and how do you believe it should be manifesr. 
in the schools? 

(a) definition: \ 



(b) operational nanifestations: 



Are you aware of a defined role for counselors in the project? 
□ , Yes 

CNo 
If no, would you like to have a defined role? 

□ Yes □ No 

If yes, please complete the following: 
(a) Describe the defined role: 



(b) Is this definition congruent with your own expectations 
(desiros).? 

□ Yes □ No If no, how is it different? 



What kinds of activities have you initiated, relative to your 
concept of career education , during this past year? 

Activity De script ion/Purpose 

(a) __ 

(b) - 

(c) 

(d) 
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12- Have you conducted any "group counseling" sessions/activities? 
ro further the concept of career education? 

rQ 

□ No ' 



If yes, how many?^ 
generally, as : 

Q] useful 

I I successful 

I F relevamt 



Would you describe these sessions, 

a . productive 

I [ meaningless 

O to students 
CZ3 to you 



What major benefits to students do you feel 
derived from these group counseling sessions? 



13. What do you perceive as your role in relation to career education 
placenient for each of the following? 

D I don't know what placement means, 
(a) Work experience: 



(b) Cooperative work ' progr2un : 



(c) Job placement: 



(d) Academic placement: 



.4. In your opinion, who should be primarily responsible for initiation 
and maintenance of career education activities? 



(a) Initiation 



D teachi^rs □ project staff □ othsr (please 
□ counselors CJ administration specify: 
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(b) Mainten2mce (on-going operations/program) : 

I I teachers Q project staff O other (please 

coimselors ( j arlninistration specify: 

15. To what extent are you aware of each of the following career 

education placement activities (programs) conducted within the 
community? ' 





Know the 

program 

well 


Know about 
the' 

program 


Not aware 
of this 
progreun 


(a) 


'Coop work experience Q 


□ 


□ 


(b) 


Career Interest Survey Q 




. □ 


CO 


New course in sales and Q 
sales promotion 


□ 




(d) 


New course in manage- 1 [ 
ment 


□ 


□ 


(e) 


Other (specify: C3 




□ 



16. Are you aware of the various training programs which the project 
has sponsored this past year? 

—Tj ■ Yes 
□ NO 

_ ^ If yes, have you participated in any of them? 

LJ Yes' 

.. Lj No 

If yes, please name those in which you have 
participat«3d: 



17. What do you perceive as the Counselor ' s role in relation to each 



of the following: 
(a) drop-out problems 
(1) presently: 
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( 2 ) de si red/future : 



(b) support- of teachers 
(1) presently: 



( 2 ) de sired/ future : 



(c) curriculum design 
(1) presently: 



( 2 ) de sired/future : 



(d) student work and/or study placement 
{ 1 ) presently :__ - 



( 2 ) desired/ future : 



(e) dissemination of career education information 
(1) presently: • 



{2) desired/future : 



18. What factors do you believe are^ or should be^ included in a 
student's ability to make quality career decisions? 



(a) 
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(b; 



(c) 



What role ^do you feel counselors should play in facilitating 
a student's career decision? 



19. What strategies do you feel would be most effective in 

facilitating a student's making quality career decisions? 



20. In what types Qf activities have you been engaged during this 
past year which would facilitate a student's acquiring a.^ 
self-awarciness of innate and acquired abilities, preferences 
and potentialc? / 



(a) innate abilities: 



(b) acquired abilities: 



j 

(c) preferences: 



(d) potentials: 



(e) none of these ]ZJ 
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21. "^In what ways have you been able to facilitate students 
relating acquired self-awareness to making a career 
decision? 

■ . *• 

(a) none □ 

(b) : 



(c) 



(d) 



22, What kinds of information have you provided students relative 
to their life roles of 

(a) citizenship: ^ ' - 



^ (b) .family: 



(c) avocational: 



(d) economic: : 



23. What kinds of counseling services have you provided students 
during this past year relative to: 

(a) selection of courses, design of an academic program: 



(b) their making continuing (after high school) plans: 



(c) their making a decision about a career lipon leaving 
high school: \ ^ ' 



(d) none of these Q 

Approximately what percentage of yolir time is devoted t'A each 
of the following: \ \ 



(a) student counseling (individual) 

(b) student counseling (group) : 

(c) ^student testing: / 




(d) non-counseling activities: 



(Please list several of these: 



(e) professional development (self) : ' \ 



{f ) professional development (others) : 

^ • \ 

(g) parent conferences t , • \ 

(h) teacher conference's :__ \ 

(i) other (specify: . 

Given complete freedom of choice about what you did as a 
counselor, what percentage of your time would you devote 
to each of the following: 

j 

(a) individual student career counseling: 



(b) group student 



career counseling: 



(c) administration of tests: 



(Name three tests you would like to give: 



) 



(d) others (specify: ^ j 
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Do you personally, or in your office, keep a file of local 
jobs available for students? % 

rHZI \ Yes 

\ | I Personally 
Q Office File 

□ ^ . " ... ■ * . 



-^If yes, approximately how many jobs are typically 
on file? " 

Lj 0-4 p 11 - 15 

□ . 5 - 10 - Q 16 or 



more 



27. Do you assist students to select from among available jobs? 
I — (Hi ^es 

•Q No . ' 

->If yes, in what ways? , : 



28. Do you openly serve as a facilitator of student employment by 
responding to employers requests for student employees? 



I — Q Yes 
Q No 



If yes, approximately how msmy calls per week do you 
receive from employers? 

LJ None □ 4 - 6 Q 10 or more 

□ 1 - 3 □ 7 - 9 • 

Is the frequency of calls about the same throughout th^ 
school year? 



r 



i_J Yes 
O No 



If no, during What part of the year do you roceive 
the most calls? 



U fall □ winter Q 



spring 
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9v How do you feel about providing -job placement services fcr 



students? 






{ [ Fine, it should 


be 


a part of counselors' responsibilities • 


.j 1 I do it because 


it 


is expected. 


[ [ I do it because 


no 


one else offers this service • 


LJ ^ don't like it 


at 


all. 


Comments : 







0. Do you provide an "aptitude" coxinseling service, i.e., do you 
give any interest or aptitude tests and subsequently, interpret 
these for students? 

I i Yes, I give the following tests: (a) 

(b) 



l~[ No, I don't give any tests. 

Do you ever discuss a student's potential for various jobs 
without test data available? 

rQ Yes 
P No 



If yes, what: is the nature of such counseling sessions, 
i.e., ' . 

(a) What do you discuss? 



(b) How do you determine the student's aptitudes? 

(c) Is this a preferred counseling strategy? 

D Yes Q No If no, what would you prefer? 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Falls, Montana 59^03 

197h ■ . \ 

' Evaluation Questionnaire 

^ Counselors . 
Form II 

Listed below are several concepts which may be considered com;.onents 
of a Career Education Curriculum. *For each concept, would you please 
answer four questions by checking the appropriate space(s): 

1. Should the concept be included, in a career education 
curriculum? . 

2. How important is, the concept? 

3* To what extent can the concept presently be observed 

in the curriculum? " " ^ \ 

To what extent, or degree, should you be ^responsible'^ 
for .assisting students to attain this concept? 



o 



V4 

o 
-p 



a 3 

O rH 

-»-^ o 
cd -H 



cd Ti 
fx, (i5 



o 



vareer Education Concents 



•Students be familiar 
with the values of a 
work-^orientoti society. 



Students accept the 
values of a work- 
'oriented society. 



Yes 



Nc 



2: -p 
a. 

o a 

' o 



o ^- 
rr -P 



Ve 



Ave 



Not 



c 

O 

-P 

c 

0) <D 
-P -P X) 
X p. 

V ^J 
C H 
O 2^ 
O W 
CO 
0) w 
o fx" 

^ 4^ 



-P 
cd 

x: 



OJ 



A 

Sreal 
Deal 



Some 



Not 
At 
All 



P'ully Some None 



rxi I 

M CO or- 

. ^ -P -H 

O O 01 -^^ 
,^-> c 

o 

o ^ o 



o 
o 



4J 

a. 
a 

o c 

8 

•H 

' . CO 

O -P 
B 
-P 

OJ o 

cd 
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> 

-A. 


Part of a Career 
Education ^-' 
Curriculum? 


How IMPORTANT is 
this concept? ^ 


To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
X, curriculum? 


CO . T-i 

r-a ^ o a 
rri r < o 

:3 O ^^ C d 
O XX O (D O 


Need more 'Info 
about this concept.' 


^Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


-A 
Great 
ueaj. 


' So2ie 


i Not 
At - 


r — ^ 

Fully 


Some 


None 




Students find work both 
meaningful and satisf7- 
inK. 
















V, 










Students understand work 
as effort which produces 
benefit to -self and 
others. 
















\ , 


1 








Each student understands 
and accepts himself. 
















\ 


1 

i 








Thorough understanding 
and acceptance of self, 
the student is able to 
live effectivel/ in 
society. 


















j 








Each individual is able 
to resolve, his concerns.. 










$ 








■ t 

\ , 






Each student possesses * 
information about hie 
innate and acquired 
abilities, capabilities, 
preferences, and poten- ^ 
tinls. 








- 








\ 
\ 


j 

\ 

1 
1 






Each student possesses 
knowledge about specific 
occupations. 
















1 
t 
t 


\ i 






Students who so desire may 
become prepared for em- 
ployment in a specialized 
job area. 










\ 






■ j ' 

i ■ 1 
' I 


i 
i 




1 



-L3-^ 
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Part of a Career 
Education ^ 
* Curriculum? 


How IMPORTANT is 
this concept? 


. To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
"curriculum? 


How RESPONSIBLE 

should .you be, 

for the attain- ^ 

ment of this 

concept'? 


a. 

0) 

o 

o c 

HH' O 

c o 

CO 

O .H 

x: 

O -P 
3 

-P 
0) o 


Career Education Concepts 


Yes 


No 


Very 
> 


Ave 


Not 


■ A 

areat 
Deal 


Some 


Not 
At 

/ai 


Fully 


Some 


None 




Each student develops an 
"acceptable" job atti- 
tude . 


























Each student is familiar 
with occupational classi- 
f iQations • 




■ r 




■ \ 


















Each -student is aware of 
relevant factors to be 
considered in career 
decision milking* 






/ 


\ 


• 










r 






Students are capable of 
effective occupational 
planning. 






1 /' 

\ ■ 

, \ 
/ \ 




















Students, manifest career 
awareness as demonstrated 
by their knowled about 
available career options. 




■ ( 


\ 

\ 




















Students are able to 
utilize career informa- 
tion in cluster explora- 
tion experiences. 






\ 




















Students are able to use 
knowledge about career 
concepts in the process 
of making career deci- 
sions. 




















1 

I- 

»■ 


1 




\Students are capable of 
independent learning . 






















1 







Part. of a Career . ' 
Education ^ • 
Curriculum? 


How IMPORTANT is 
this concept? ^ 


• To what extent can 
the concept 
PRESENTLY be . ^ 
OBSERVED in the. 

\ curriculum? 


: 1 

« O -H 

M Cd r/: 

CO -P »H ' 

O o cd -P 
P-i k.. ' <>• 

U) fl) -P 
K r- . .P Q) 

P o 

:s o ;h d n 
o 'XX o a; o 


Need more 'info 
about this concept. 


Career Education Concepts 


Yes 


i 

. 'No 


Very 


Ave 


Not 


A 

Sreat 
Deal 


Some 
/ ■ 


Not 
At 
All 


Fully 


Some 


None 




St]idents are able to re- 
late studies within the 
general curriculum to 
their career interests. 


























Students are able . to 
♦ exercise responsible 
judgement in career 
planning and choice. 










• 














' ■ ■ 


Each student under- 
stands' his family, 
avocational, citizen, and 
economic roles in ..life. 
























r 


Each- student^ is capable 
of utilizing information 
gained from work obser- 
vation in leami^ig about 
careers, expanding •his 
knowledge about available 
career options, and in 
making' career choices. 






,■ 


• 






V 


- 










Provide tho^e -e^qperiences 
which ^will enable" stu- 
dent]^ to ultimately find 
meaningful, satisfying 
work. 
























• 

/;■- 


Design and provide those 
experiences which will 
enable each student to 
understand himself," 
accept himself, and live 
effectively In society. 














If 




1 

i 

! 

i 

i 


' 1 


/ 

/ 
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Part of a Career 
Education ^ 
Curriculuffi? 




How IMPORTANT is 
this concept? ''•^ 


To what extent can 
the concept 
P^ESEHTLY be ^ 
OBSERVED In the 
curriculum? 


h 
n 

. O <r» fc- 

to i> .c^ 
-i: o a. 
erf . - ^> o 

o u c c 

o ^ o cu c 


Need more Inf c 
about this concept. 


• Career Education Concepts 


Yes 


No 


Very 


Ave 




A 

Great 
Ileal 


Some 


} Not 
At 
All 


Fully 


Some 


None 




Provide those serviceg 
which will enable stu- 
dents to. acquire infor- 
mation about their in- 
nate and acquired abili- 
ties, capabilities, 
preferences y and 
potentials . 




* 














'■\ 
y 




i 




Establish those services 
and experiences which will 
enable each student to 
acquire infcnaation about 
the world of work. 




















^ - 






Design and provide those 
experiences which enable 
students who so desire to 
prepare for a specialized 
Job area. 










- 






_ 




\ 
i 

i 

i 

\ 

1 




Facilitate student's un- 
derstanding the impor- 
tance of re- training or 
up* grading of accupft- 
tional skills. 


















■ 


\ 

\ 

\ 




Insure that each student 
Is able to acquire de- 
sixed occupational skills. 


















1 i ^ 




<- 

Provide cooperative work 
experiences for^thos*^ 
students who elect 'tt^ 
participate in such 
experieacen. 










1 






1 

1 


i 

i 
t 

1 

i 
\ 

i 


i 

K 

\ 
^ 

t 

i 

..„. 1 





ERIC 





1 

u 

as 

c? c: § 

0 0 
0 ^4 

U J 

a 4 w 0 


2 

0 t: 

. 

lit 

0 .a 
re ^ 


i 

a i 

^- 't-s c^. 1 I'i . • . 

D 'l> ;J r-. , r .. ♦ 
rj n r-H f^.. 

c f-^ u: :i 1 • . , 

tij 0 V ] '-i 

^ '^.J ;ri ir; .ri ;\r: . .... rn 

0 cr iXi :s ' ; 0 
i-t a. 0 .jj; rj 

I 


•4 • 

1"' 

c 

c c: 

r; 

0 -i- 

c 0 
sr .. d 


Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


A 

Groft t 
Peal 


lAllI 1 




Provide opportunities for 
students to explore ^'key'' 
occupational areas. 






— 










: : ' s 

i — i 

1 ' . < 




Establl::i\ a career odu- 
catioi'i ci^ntinuum, pro- 
gressing from career 
awareness through explora- 
tion of occupations to 
' developaeat of occupa- 
tional skillD. 












i 




!~: r , 

:^ : i 

i 




Establish and operato 
career infonnation 
center for iitudent use. 














1 






Provido in- .service train-- 
ing for professional 
Titaff in the area of 
career cducatioz;. 




1 










i 
I 


i . i 




Provide a proi^^rain of 

work experience ai? a 1 

student option. j 




i 
f 
♦ 










1 ■ ' ■ 


1 

! 

* 


ProvIJj a program of 
work cb^ervritloT: 13 a 
student cption* 










J 


. . i 


1 ■ 1 


i 



let 
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EXEMPLARY PROJECT IN CAREEB EDUCATION 



Great Falls Public Schools 
Great Fall 3^ Montana 
1574 

Evaluation Questionnaire 
Teachers Form I 



What IS the grade level of the majority of studc^J 



L=! 


1 - 


3 




4 - 


6 




7 - 


9 


a 


9 - 


10 


1 ! 


11 - 


1? 


Q 


9 - 


12 



Chock the box which best descr'ibes your major teachxTK 

\ ] S^lf-contained 

I I Science 

[ ] Mathematics 

dj Social Studies (not a foreign lan-juaae) 

l_j Other (please specify: 



v;hrit ir> your age? 



d 


20 


- 30 




31 


- 40 


C2 


41 


- 50 


CJ 


51 


- '60 


0 


61 


- Over 



Vour sex? 

~ Female 
Male 



Which of the following best describes the grade iovels 
in your schcctl ? 

tZ) 1-6 
[d ^ - 9 
C3 ICl - 12 

Ver.: in Groat Fails? 

vS . \ ^ ^ a 10 - 12 

• ^ ' en 13 - over 
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'which of the following best ;j:oti.cribes your prosenL lovo.. 
college training in teznus of degree (s) and quarter hour:-^' 

Bachelor Degree 
Bachelor + 15 hours 
Bachelor + 30 hours 
Master ' s .Degree 
Master's + 15 hours 
Master's 30 hours 
Master's + 45 or mere 

Please list the last four positions you ha^c Id in edi. -at 



Position 


Years 
Held 


Nature of V/ork 


•• 

1 












i 














How would you ticfine "career education" for the. Grc.t: r.^lls 
schools? 



^ ^ — . — \ . , 

v;hat role do you perceive for yourself in the deveicnn\ci a 
integration of the career education concept you descri: r^r. 
(Check ciil appropriate spaces.) 

Cj Curricul\:yn development 

O Developing new instructional strategies 

s CH Developing strategies to integrate career cdKcati 

Cj Counseling students 

I , 1 Reorganizing curricular patterns 

CI other (please specify;; 
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In what ways do you feel "career educacion'' its difforcnr ir 
or the same as what you have done in tho past? (Check ill 
appropriate spaces) 



Different 



CD 



Curricular relevance 

Increased self -awareness 

More direct work experience 

Greater awareness of 
career opportunities 

Increased lev(Sl of 
occupational skill 



Other (please specify: 
Other (please specify: 



) 



Similar/S; r; 



f 



I j 

! — i 



In what ways do you believe career: education is different t. 
vocational education? 



Career Education 



Vocational Education 



(a) 



(b) 



(c) 



CJ I believe they are the saine--or very similar. 

O r don't know — but would like to know. 

What implications does a career education curriculuir. {progr.i 

have for you: 

. I ^ -■'.'one r~i 
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(3) 



(b) Professionally 

( 1 ) None [ J 

(2) 



(3) 



Have you perceived^ or suggested for purchase, any materia; 
for the specific purpose of potential adoption/acquisition 
to foster career education in the curriculum? 

-lH Yes 

□ NO . 
* ^ If yes, what t:/pes of materials? 

f r films 

( I film strips 

I 1 audio tapes 

I I other (please specify: ) 

What proceduria was employed to inform you about 
materials available for preview? 

di I was asked to look at specific material 
O I saw a brochure in the district. 
O I was sent a brochure. 

lZ3 A colleague mentioned these materials to me. 
i — I I saw it (them) at the Career Education office. 
CIj a project staff member told me aboyh it (thenO . 
lZ3 Other (please specify: ^) , 

Have you participated or enrolled in either in-service trai 
or college courses related to career education? 

LJ Yes 

□ NO 

^ If no, please answer the following questions: 
(a) Were you aware of programs offered? 
□ Yes a No 
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(b) If you were aware-* of these programs, but did 
not enroll/ was there a specific reason? 



7 



Yes n No 
If yes, what: 



(c) Are there any programs which you feel are 
needed but not offered? 



L 



3fes □ No 



.) If yes, please name the programs you 
feel are needed: 



/ 
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EXEMPLARY PROJRCT IN CAREER EDUCATTOU 

Great Falls Public Schools 
Great Falls, Montana 59^*03 
I9lk 



Evaluation Que'stionnaire 



Teachers 
Form II 



t 1 

Listdci bolow ar^ several concepts which may be considorod component 
of a jCaroer Education Curriculum. / For each concept, vould you plea 
answer four questions by checking the appropriate space(s): 

1. Should the concept be included in a career education 
curriculum? j 

2. How important is the concept? 



3- To what extent can the concept pi^esently bo obaorved 



in the curriculum? 



4. To what extent, or degree, should you be responsible 
for assisting students to attain thic concept? 



^iv*^nr Education O'urf^p^r^ 



v?tudcnls b<' familiar 
with thp values of a 
wcrk-oriente'l r;oc Lc ■ >v 



Students accept the 
vnluea of a work- 
oriented societj . . 



u 
i> 
c> 
t* 

C3 

« CI n 

O o 

C> ^ 

J- u 
a. w o 



No 



Very 



Ave 



Not 



c: 
f ) 
»-> 

a? 
♦ ^ 

:» 
o 



'V 

to t-: 
o w to 
si p to 
-^^ o 



1.1 



A 

)rrn \ 
Deal 



Not 
All 



i I ..a 

O O CI 

Uj o 



4 ^ 



It ''^^ I. 
O J-J c 



o 

n a 
< o 
d o 



1' o 
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Career Education Concept; 



Students find work both 
meanin^-ful and satisfy- 



Students underntand work 
an effort which produces 
benefit to self and 
others. 



Each student understands 
and acc<5pts himself • 



If 

'^4 rrt 



O -» 



4J 



a* Cx:] CJ 



No 



O 



♦ ■ 
0) 

(J 
c 
o 
o 



Very 



Ave 



Not 



o 



o 

o Ctj ft: 

s: or' VQ 

-p a, o 



3 

o 



A 

Deal 



Some 



Not 
At 
All 



^^^ullv 



to 

O 
o 



el 



4 J o 

o o 



Sone 



None 



o a 
o 

•r 

a 
n 

-a :^ 
u. o 

>'z CO 



Through understanding 
and acceptance of self, 
the ntudent is able to 
live effectively in 
society^ 



Each iTidividual is able 
to resolve his concerns. 



Each stM'vlent possesses 
infc- - about hir 

Ir.nr.i./ acquired 
abilities, capabilities, 
preferences, apd poten-- 
tinls, 

D , 



ntudent posse- ^es 
knowledge about specific 
occupations • 



.'students who so desire may 
bc^o.-ne prepared for em- 
ployment in a spO;Cializod 
job area* ^ 
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Career Education Concopt.n 



Each student develops an 
"acceptable" job atti- 
tude. 



Kach student is familiar 
with occupational classi- 
fications . 





1 

1 




t. 






a) 






a* 






u 






ai 






C.) 






Cl 


r. 






o 




^^ 


•ri 




o 




















n1 




0) 




=1 


cx, 


W 


O 



Yes 



No 



to 

f < <]) 

o c 

P4 o 

to 

o .c 

a:: -P 



Very 



Ave 



Not 



a. -H 

o :r- t^. 
n CO f»l 

0) W CO. 
O ^ cr cq 
^ D , O 



4> 

t: 

X 

1) 



o 



A 

neal 



Some 



Not 
At 
All 



P'ully 



m <i> .H 

CO 4^ 

;3 ^ 

O o aj 
a. K 

y Tij ^ 

Cd 4^ 

2 o a 

o x O D 



o 



O4 

o 
c 
o 
o 



o 



u 
o 



4^ I 

o I 

^ I 
o 

o I 



-P 

o 
qS 



Some 



None 



Each student is aware of 
relevant factors to be 
considered in career 
decision making. 



Students are capable of 
effective 
planning. 



effective occupational / 



Students manifest cnveer? 
awareness as domon.'^trated 
by their knowled about / 
available career options. 



Students are able to / 
utilize career inform?/- 
tion in cluster explora- 
tion experiences. / 



Students are able toMinc 
knowledge about care.or ' 
concepts the prodes 
of making career deci- 
nions. / 



/ 
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Students are capable of 
imdepcndent learning. / 
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• 


J, 

a- 
ii 

u: :i 
^^ -ri :i 

^ li U 
Ul 0 


. 2 

i n ^ -•» 
0 

p' 0 
r> c: 
ri. c) 

f:i " 

0 s: 


3 

ri 
f) 

• .s 

' 4^ .n. 
M a. .r-b n 
0 0 "J 

r~j 

c * ri 
rJ 0 ; : . 0 
r> fi] n'l 'rf 

c/ > M 

0 ^ Cr CQ 3 
*^ cu 0 0 


Hew RESPONSIBLE 

should vou be 

for the attain- ^ 

ment of this 

concept? 


Meed more Mzif 0 
about this concept. 


Career P>iuca^ion Goncopf :'; 


Yes 


No 


Very 


■ Ave 


Not 


A 

Irea \ 
Heal 


Some 


Hot 
At 
All 


Fully 


Some 


None 




Students are able to ro- * 
•late ctudie? vithin the 
general curriculum to 
their career interests. 


























Students are able to 
exercise responsible 
judgement in career 
planning and choice. 


















- 








P^ach student under- 
stands his family, 
nvocational, citizm, and 
economic rolen^in life. 


























Each student is capable 
of utilizing information 
gained from work obl^^r- 
vation in learning about 
caroern^ expanding his 
knowledge about nvailable 
career options, and in 
making career choices. 



























Provide thor>e experiences 
which will ennble ntu- 
i*?ntr^ to ultiranv.'ly V\nc] 
•n-nningfuJ, .^ntisfying 
work . 


























n-'-^nif^n a:vl provide those 
exrrrioriwii which wi]J 
enable tmrh r^tudont to 
under:? tnnd himself, 
nccopt hlranelf, and live 
effectively, in- society. 
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Carrier fc/iucat^ion Concenh 



Fi*ovido thoiio servicGH 
which will enable ntu- 
dcntjj to ncquirc infor- 
mfition about their in- 
nate and acquired abili- 
ties, capabilities, 
preferences, and 
potentials*. 









'.0 




•1' 






•* * 




n> 










Pi 






i: 




a5 










K ) 




n 








t: 




ft' 






o 






t: 






:i 


n, 




o 


4 1. 

rl 


r ) 






• 


(J 










ri 




.'I 








•J 


a 




o. 






in 


4.? 



Ho 



Ver^ 



/V\'e 



Not 



o 



C) 

O » J f ^ 

ro i'l 

<U frl CO 

x: cr CD 
a. o 



^1 



A 



sono 



Not 
At 
All 



f.O 

:i 4^ x: 



o 
rr: 



0) <M 

•d ^ o 

1:1 

O 

XI O 



a; o 



45 

a. 

Q) 

o 
c 
o 
o 

' to 

o -P 
B 

4J 

0) o 

a; rO 



o 



ully Some 



None 
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Establii^h thor;e sorvicon * 
and experiences which will 
enable each student to 
acquire information about 
the world of work. 



Design and provide those 
expf?ricnccs which nnabio 
students who so desirf* to 
propare for a specialized 
job area. 



Facilitate student'^ un- 
derstanding the impor- 
tance of re-troininf; or 
^^P-gradfng of occupa- 
tional rkills. 



Insure that each student 
is nblo to acquire de- 
sired occupational skill: 



Provide* ccopeifativo work 
'^xpf'riences for those * 
st:,idents who elect to 
part icirato in such 
expcTiencos. 
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• 








t. 








a* 






■H 


o: 






























n, 






w 




CTl 


n 








o 


"J 


o 


'.-4 


•f < 






o 


■4 ' 


<> 










.f:{ 


» ' 


o 




















o 




w 


o 











Q) 














c: 










^) 




o 










.o 






y\ 










a) 


r.) 

t: 


:-i 
. \ 
I « 


ft.1 












o 






r; 












^4 




a 




CO 


^^ 


0 






cq 






♦J 


a. 


O 


o 



to 




1 






-1 




a 








o 












ca 


W 




ro 












x: 




o 


o 






















0> 








' ■ "1 


th 


O 


C) 




;^ 






o 


:» 


o 




c 




o 


x: 


o 




o 








a 


o 













0) 




o 


o 


c 




o 




o 




w 








.a 


o 


+5 


0 






-p 






0) 


O 






05 



Careei' E<]ucfition Conceptr 



Provide opportunities for 
students to explore "key" 
occupational areas. 



Establish a career edu- 
cation continuum, pro- 
gressing from career 
awareness through explora- 
tion of occupationn to 
development of occupa- 
tional skills. 



No 



Ave 



Not 



A 

]refl■^ 
Dcnl 



Not 
At 
All 



Some 



None 



Establish nr-] operate 
career information 
centers for student use. 

Provide in-sorvice train- 
liig for professional 
staff in the orea of 
career education. 



Provide a prograni of 
vork t xperLexice as a 



tvcvv^e n prrgram of 
V o r • k o b s 0 r va t i c n a s a 
:;hudont op-tion. 
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EXEMPLARY ' PROJECT IN CAREER EDUCATION 

Great Falls Public Schools 
Great Falls, Montana 

Evaluation Questionnaire ^ 
Teachers Form III 



What rs the grnde level of the majority of students you teach? 



□ 


1 


- 3 


□ 


u 


- S 


□ 


7 


- 9 


□ 


9 


- 1C 


a 


11 


- 12 


□ 


9 


- 12 



Check the box uihich best describes, your major teaching assignment 

I I Self-contained 

rn Science 

I 1 Mathematics 

I \ Sppial Studies 

I I Language Arts (not a foreign language) 

I 1 Other (please specify: ) 



What is 


vnur 


J3ge7 


□ 


20 - 


3d' 


□ 


31 - 




□ 


^♦1 - 


50 


□ 


51 - 


6Q 


O 


61 - 





Your sex? 



fn FGmale 
O Male 

Which of the Falloujing best cisxcribes the grade levels included 
in your school? 

□ 1 - 6 

□ 7 - 9 

□ 10 - 12 ■ 

Vears in Grent Falls? 

□ ^ - ^ ■' ■ 
O - 6 □ 10 - 12 , 

D " - 5 □ 13 - Over 
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^ iJhich of the fclloiuing bast describes your present level of 
rollegrs training in terms of degreeCs) and quarter hours? 

I I Bachelor Degree 

V Q Oachelor ^15 hours \ 

£□ Bachelor + 30 hour-^ 

I I Master's Degree Vv 

□ Master's +15 hours ' 

□ Master's ^ 30 hours 

i~| Master's + ^5 or more hours \ 

I \ Doctorate ^ 

8. Please list the last four positions you hav/a held in education. 



Position 


Ysars 
Held 


Nature of Work 





















During recent years there has been considerable emphasis upon the 
concept "Career Education." What does this concept (CarPe? 
Education) mean to you? 



10. 



In yhat mays do you believe the concept you defined could best be 
incorporated into the curriculum? 



(a) 
(b) 
<c) 



Please Eontinue to the next page 
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Dr. you presently Include ./areer Education in YQUR program? 

ves ' 

: i r-io 
i 

' if Ves, v^st ways? 



Whet types part Sfjrvicos for Career Education 

In^tructiof 

(a) Da you ... . 



(b) Would you LIKE to have: 



12. In uhat ways da you feel Career Education is different from 
general education? 



(d) 



i i I Deiieve they are the same 
|~) I don't knou 

i~l I naven't thought about this issue 

13* In ujhat u.t3ys do you feel Career Education is different from 
Vocational Education? 



l~l I believe they are the same 
fj I dcn't know 

□ I haven Vt thought about this issue 
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tiJould you like to learn ittavB jhout Career Education? 
pD Yes 
□ No 



If Yes, which method would be most effective: 
1 1 In-serwic^ program 
I I Formal courses 
|~) Reading lists 
f~l Special brochures 

I I Other (please specify: 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Falls,. Montana 
1974 

Evaluation Questionnaire 

Administration 
Form I 



Please check the space which describes your present position. 

□ elementary principal Q high school principal 

□ junior high principal □ central administration staff 

I I other (specify: j 



For how many years have you held your present assi 
□ 1 - 3 □ 7 .-^ - 



nt? 



□ 4-6 



f^] 10 or iTiOre 



For how many years have you been associated with the ^reot Fa^l^ 
Public Schools? 



□ 1 - 3 

□ 4-6 

What is your present age? 
I } 25 or younger 

□ 26 - 30 

□ 31 - 35 
Q 36-40 

What is your sex? 
Female 



Lj 10 or more 



Q ''6 - 50 
CI 51 oT.d over 
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Which of the following best describes your pre'-ent level of 
college training in terras of degree (s) and quarter hours? 



ri BA + 15 hours 
I [ BA + 30 hours 
D MA 

□ MA + 15 hours 



Q MA + 30 hours 
Q MA + 45 hours 
" EdX) or PhD 



1. 



You^are undoubtedly aware of the Career Education Project in 
the Great Falls School District. What, do you perceive as the 
major purposes for the project? 



(a) 



(b) 



(c) 



o: th- following career eQ\;oation concents do vou f^pi 

1 report a:: t, and (2) mar.ir.^st in your" nrosent curriculum'? 
'A -ancepu may be important but • obsf.rved in yonr schoel ) 



Check all appropriate spaces. 



(c/ 



(e) 

:f ) 



Concepts 



(a) Understand oneself 

(b) Relationship with others 



Iinportant 



Yes 



Career Orientation 
d) Career Information 



Economic Awareness 
Coiisuxner Competency 

Career skill explora- 
tion 



No 



1 81 



Manifest 
in Curric 



Yes 



■f 



Ko 



CoTO^ants 
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erJc 



Concepts 


Impoi 






Manifest 
in Curric. 


i 

1 Cononents 


Yes 




Yes 


No 




(h) Career decision -making 

(i) Career planning 

(j) Occupational skill 

development 
(k) Application of occupa-* 

tional skills 

(1) Placement, stability 
and advancement in a 
career of choic: . 




i7 











Of those concepts which you indicated were important, which do you 

(ctLi''t^^^l^'^ adequately addressed by thx. Career Education ?roject? 
(Check all appropriate spaces.) '-'jct-u. 



(a) (b) (c) (d) (e) (f) (g) (h) 



(i) (j) (k) (1) 



4. 



□ □□□□□□□□□□ o 

Of those concepts which you indicated were presently manifest in 
your curriculum, which were installed largely as the result of 
the Career Education Project's efforts? (Check all appropriate 
Spaces » / . «. 



(a) (b) (c) (d) (e) (f) '(g) (h) (i) (j) (k) 

□ □ □ □ □ □ □ n a a a. 



(1) 



5. Have you participated in any training programs sponsored - K-r- 
Career Education Project during this past year? 

rCj Yes 

,□ NO 

■ Vlf yeSr which one(s)7 

(a) ^ 

(b) _ ^ 

(c) • 

(d) ■ ■ ~ 

"(G) 
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How would you rate the effectiveness and usefulness 
each program you listed on the previous page? 



Program 


Effectiveness 


1 Usefulness 


Verv 


i Ave 


Not 


Very 


' Ave 


Not 


(a) 














(b) 














-(c) 














(d) 








( 






(e) 








• 




1 



6. What do you perceive as your role in the development and im- 
plementa-^on of Career Education inyour school relative to 
each of .he following: 

(a) increased student awareness of career options: 



(b) reduction in school drop-outs: 



increased vocational guidance services: 



(d) --tudent opportunity to make career choices: 



((. ) i:. creased relevance of the curriculum: 



(f) involvement of school stciff in career education: 



What procedures do you typically employ to effect involvement of 
parents and other concerned publics in school programs? 



What do you feel are the most significant obstacles ^^to the design 
installation and operation of an effective career education cur- 
riculum, i.e., staff, money, space, etc.? 



(a} Design: 



(b) Installation: 



(c) Operation ■ (eva2.ua ti on, management, etc.): 



9. The expected outcomes for the Career Education Project, as in- 
cluaed m the original proposal, are listed below. Recognizinq 
that the project is in the first of three years, would you 
please give U5. your opinion of how well the project is pro- 
gressing toward attainment of these outcomes? 

j-^g£lgj::gj- Overall Rating 
* ^f Progress 



Very vv 
Expected Outcomes High Averacfe 



very 



(a) Increase ^^t^^^^' r-iWci^reness 

of the bro ,a .je of career 
options 



a 



(b) Reduction in school drc.^:'-^;iats [j []1 Q 



tc1 rj-Kjreaseo vocationar guidance FT ' " ri " (""f 

scrvicos 18 i ' — — 
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3. 



Expected Outcomes 

Id) More realistic career choices 
by students 

(e) Increased relevance in the 
school curriculum 

(f) Increased educational and 
job placenient'y' 

(g) Involvement of teachers and 
admininstrati^bn in career 
education ■ j; 



Genec- 

Very 
High 

□ 

a 
□ 
a 



c r Overall Ra 
O f Progress 



i/ 



Avoraqe 

u 
u 

p / 



liJ 



□ 



□ 



The project staff ijiave employed the activities : is ted below t-ol 
foster attainment of the desirec3 outcomes for zre n-f)i,'ect Ratr- 
the effectiveness of each activity by check 1;!- the :ipLjlropkate 
space for only dhose activities which you have obsorvdd. 



1 

1 


Not 
Observed 


<u o 
> h:: 


Low J 


■ I 
(} 

K. 

f 


1 i 

1; 

'.a 

■ 

! 


! 

( 
1 

1 _ 


(a) Career Edjication Course, 
Winter 19/4 (Ed 571) 








1 

i 


i 




(b) Administration of the Career 
Av/arencssj Inventory- 1974 














(c) Interacti/on with the "Next 
Step" prcjject 






1 1 
♦ 


. \ i 




1 


(d) Staff visitations to other * 

scnools 








ii 

'i 


1 


1 


^ Teacr.-'^' cr: u-ii ttees to develop ! 

rocr:: r'l iivi t ions for use of • j 
f ' "^^"'^ V ••.::50urce people and i 

L. ■ • - ■ 1 






u 

i 

1 
1 
» 


' — r — 1 

! : 


-'i 'I by t.-aciierii 


! 
1 






! 


r 

p. 

i 


1 
1 

-■1 


,1 /Taiv^^r Days'- a ?t Ivi tjos 


1 

i 
t 


f 

-1 1 


t 
1 
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11. Generally, how 'konld you rate management of the project? 



Effectiveness 
Efficiency 



Very 

Low Low 

□ a 

□ u 



Average 



High 



□ 



Vcn-y 
High 

□ 

n 



List specific incidents, examples, problems, and/or decision 3 
which contribu|:e to your rating of project management. 



12. Generally, how 



Useful 

Important 

Significant 

Effective 

Feasible 



13, 



14. 



do you rate the total project? 
Low Average 



Very 
Low 



I I 



i I 



L_l. 



"_J 



Hi v7h 
I -J 

I 1 



Very 
Hi gh 

CI 
Q 



List one incxdent and/or example which illustrates your ra^-j-^r- r 
each of the dimensions listed above. ' ' 



Useful 



Important 



Significant 

Effective 

Feasible 



Approximately how many innovations have been "installed'* in your 
school during the past two years and are currently operational? 



I I None 



CJ 4-^6. 
I I 7 or more 



the three most significant, in termi^ cf 
-fort upon the school. 



186 



-39- 



ERIC 



(b) 

(c) ■ ' 

Are costs a significant factor in deciding to install an innovation? 
-G Yes 

G No ' 

^ If yes, what types of expenditures do you classify as installa- 
tion costs? 

(a) (c) 

lb) : (d)_ . 

Please describe the model you would employ to install both a complex" 
innovation, such as differentiated staffing, and a simple innovation , 
such as a new media service. 

(a) Complex :_ 



(b) Simple: 
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EXEMPLARY PROJECT IN CAREER EDUCATTQN 



Great Falls Public Schools 
Great Falls, .Montana 59^03 
197^ 

Evaluation Questionnaire 

Administration 
Form II 

Lifted below are several concepts which may be considered components 
of a Career Education Curriculum. For each concept, would you please 
answer four questions by checking the appropriate space (s ) : 

1. Should the concept be included in a^ career education 
cu'.riculum? * ' . 

2. How important is the concept? 

3. To what extent can the concept presently be observed 
in the curriculum? 

h. To what extent, or degree, should you be responsible 
> for assisting students to attain this concept? 



0) 

c 

05 

ctf C § 
O f-l 

O O 

u, :^ u 



Career Education Concopt.r; ^es 



Student«j be familiar 
with the values of a 
work-oriented society. 



Students accept the 
values of a work- 
oriented society-. 



No 



-a; a. 



o 
ft, 



o ..J 



Very 



o 
•p 



Ave I Not 



jrefl I 
Deal 



o 



o 

a. 

O 2.^ 



-p 

H ^* 



O 



J5ome 



Not 
At 
All 



CO 
•H 



CD 0^ 

M .a ca 

CO -P 

-p j:: 

o ca -p 

g ^ o a 

'3 -P 

^ o u, c 

o x: o o 



O 
a, 

CO 



o 
o 
c 
o 

o 



o 
o 

! S 

I 

w 

O 4J 
Q 

•p 

0) O 

. <D Xi 

as 



Fullv 



Some 



Nonc£ , 
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Part of a Career 
Education ^ 
Curriculum? 


/ * 2 

w 

F-H C 

- : p 

< Oh 

E-» 0) 

pr' O 

o a 
a, o 
g o 

w 

o jc: 
a: -p 


To what extent car. 
the concept 
PRESENTLY be ' ^ 
OBSERVED in the 
curriculum? 


" 1 

How RESPONSIBLE 
should you be 
foi^ the attain- 
ment of this 
concept? 


Need morClnfo 
about this concept. 


Career Education Concepts 


I 

Yes ! No 


Very 


•Ave 


Not 


A 

C^reat 
Deal 


Soae 


Not 
At 
All 


Fully 


Some 


None 




Sturio^ J find work both 
meaningful and satisfy- 


























Students understand ; ork 
a:3 effort which produces 
benefit to <?e1f nnH 
others. " 


























Each student imderstands 
and accepts himself. 


























ThrOUC^h undpT^^f anH-i ntr 

and acceptance of self, 
^ the student is alble to 
liv*=* effect! velv -in 
'Society, 


























Each individual is able 
to resolve his 'Concerns . 


























Eacl: student possesses 

inf C rmfl ti on nVinu"f ViT o 

innate and acquired 
abilities , capabilities , 
preferences, and poten- 










1 
















Ench student possesses 
knowledge about specific 
occupations. 


























Students who so desire may 
become prepared for em- 
pl'^yment in a specialized 
job area. 
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• 


Part of a Career 

Education 

Cjarriculum? 


How IMPORTANT is 
this concept? 


To what extent can 
the Concept 
PRESENTLY be ^ 
OBSERVED in the 
curriculum? 


How RESPONSIBLE 
• should you ^e 
. for tjie attain- V 
. ment of this \ - 

concept? 


Need more' Info 
about this concept. 


Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


Sreat^ 
Deal 


[Some 


Not 
At 
All 


Fully 


Some 


None 




Each student develops an 
"acoi f>able*' job atti- 
























\ 


Eac; i ient is familiar 
^±U. : 'Jupational classi- 


























Each c*tudent is aware of 
1 rel^r^vant factors to be 
1 >nsidered in career 
f decision making. 


























Students are capable of 
effective occupational 
planning . 


























^Students manifest career 
awareness as demonstrated 
by their knowled about 
available career options. 












I 














Students are able to 
utilize career informa- 
tion in cluster explora- 
tion experiences. 


























s^.tudents are able to use' 
knowledge about career 
concepts in the process 
of making career deci- 
sions. 










•> 
















Students "ar 6 capable of 
independent learning. 
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-P O J* 
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CU W O 



o 



o 
o 



CO 
O JC 



o 
-p 



0) 

-P Xi 

O 7Z 
O M 
CO 

O Si cr" 
E-« Hp Cu 



-P 



X 

-P 



CO u 

o o 



w 

•-3 

CQ 

»-< 

CO 

o 
to 

O 



I 

_^ -P ^ 

^ -p x: 

O qj 43 
>» 

O Q>4 -P 

1-^ -P 01 

o u a c 

«C O O o 
(0 <^ Q 



4> 

a 
o c 
^ o 

o 

• tfl 
O 1-1 

O 43 

B 

43 
<P O 

o ^ 



Career Education Concepts 



Yes 



Students are able to re- 
late studies within the 
general curriculum to 
their Career interests. 



Students are able to 
exercise responsible 
judgement in career 
planning and choice. 



Each student under- 
stands his family, 
avocational, citizen, and 
economic roles in life. 



No 



Very 



Ave 



Not 



A 

Great 
Deal 



Some 



Not 
At 
All 



Fully Some 



T 



None 



Each student is capable 
of utilizing information 
gained from work obser- 
vation in learning about 
careers, expanding hiS' 
knowledge about available 
career options, and. in 
making career choices. 



Provide those experiences 
which will enable stu- 
dents to ultimately find 
noaningful, satisfying 
work* 



Decign and provide those 
experiences which will 
enable each student to 
understand himself, 
accept himself , and live 
effectively in society. 
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f>4 

o 



S o 



u 



o c 

pu o 



o 



c 

X 



g5 

o 



O 

a, 
c 

o Si 

CO 

PC* 



o 
-p 



^1' 



CO 

o 



CO 



M ^ Oj 

CO -P 

25 :3 -P 

O O Oj -P 

CO ® C-i -P 
TJ J3 O 
iH -P <D 
Jl -P O 
> O C C 

o j:: o o o 
tx; CO ^ S o 



-p 
o< 

o 
o c 
o 

d o 

• CO 
O -H 

O -P 

s 

-p 

o o 
o ^ 



Career Education Concept n 



Yes 



No 



Very 



Ave 



Not 



A 

Preatj 
Deal 



Some 



Not 

At 

All 



?*ully Some 



None 



Provide those servizes 
vhich will enable stu- 
dents to acquire infor- 
mation about their in- 
nate and acquired abili- 
ties , capabilities • 
preferences, and 
potentials • 



Establish those services 
and experiences which will 
enable each student to 
acquire information about 
the world of work. 



Design and prdvide thOHe 
experiences which enable 
students who so desire to 
prepare for a specialized 
lob area. 



Facilitate student's un- 
derstanding the impor- 
tance of re-training or 
up-grading of occupa- 
tional skills. 



Insure that each student 
is able to acquire de- 
sired occupational skills- 



Provide cooperative work 
experiences for those 
students who elect to 
participate in nuch 
experiences* 
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n 






«. 


.Part of a Career 
Education 
Curriculum? 


How IMPORTANT is 
this concept? 


-To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
curriculum? 


H 

W 1 

^ c 

O O g5 

CO O C-i 4^ 

w T5 o ou 

Orf fH -P <1> 

> O C ^3 
o x p C) o 


Need more 'info 
about this concept. 




Career Education Concepts 


Yes 


No 


Very 


Ave 


Not' 


A 

Srea-t 
Deal 


Some 


Not 
At 
All 


Fully 


Some' 


None 




\ 

\ . 
\ 
\ 

\ 


Provide opportunities for 
students to explore "key" 
occupational areas. 
























r 


Establish a career edu- 
cation continuum, pro- 
gressing from career 
awareness through explora- 
tion of occupations to 
development of occupa- 
vXunaj. SKx J.J.S • 
























\ 
\ 

\ 
\ 

\ 

; 


Establish and operate 
career information 
centers for student use. 
























\ 

I 

\ 


Provide in-service train- 
ing for* professional 
staff dn the area of 
cBire er euuca oi on . 


























TrbVrde^a "pYog^^ * 
work experience as a 
student option. 


























\ 

\ 

\ 
\ 

\ 

\ 
1 

\ 

\ 

\ 


Provide a program of 
work observation as a 
student option. 



























i 

\ 
\ 
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Great Falls Public Schools 
Great Falls, Montana 
1974 

Evaluation Questionnaire 

Parents 
Form I 



The following questions have been designed to provide us witli 
descriptive information. If you are maurried, please provide ^ 
the requested information about yourself and your spouse. 



Present occupation 
Yourself: 



Your spouse: 

I [ Not married 



□ 
LJ 



Divorced 

Separat/ed 

Widow/Widower 



Years in your present occupation 
Yourself: 



Your spousel: 

Present- age t ; 

Yourself 



-I 



□ 


26 - 30 


□ 


□ 


31 - 35 


□ 


□ . 


36 - 40 


n 


□ 


41 - 45 


□ 


p 


46 - 50 


□ 


□ 


51 - 55 


a 


□ 


56 - Over 


□ 
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•Your j}po\x0^ 



4. Your present income: 



Yourself 





$3,000 - 


$5,000 


n 

1 1 


ri- 


$5,001 - 


$7,000 


J — 1 


n 


$7,001 - 


$9*000 


1 1 


I — 1 
•—J 




> 1 1 ,UUU 




□ 


$11,001 - 


$13,000 


□ 


□ 


$13,001 - 


$15,000 


□ 


□ 


$15,001 - 


Over 


□ 



<r Your spouse 



5. Your sex: 

Yourself 

□ w ■ 

6. »^ Nunber of children in school (total: 

Grade K Q Number of /boy(s): 



Your spouse 



□ 



J 



Grade 1 
Grade 2 
Grade 3 
Grade 4 
Grade 5 
Grade 6 
Grade 7 
Grade 8 
Grade 9 
Grade 10 
Grade 11 
Grade 12 



n 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
n 

D 

o 



boy(s): 
' boy(s): 
boy(s): 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 
boy(s) : 



Number of girl{s) : 
girl(s): 
girl(s): 
girl(s): 
girl(s): 
girl(s): 
girl (s) : 



girl(s): 
girl(s): 
girl(s): 
girl(s): 
girl(s): 
girl(s): 



7. Level of education completed (circle highest) 

Yourself: 1 2' 3 4 5 6 7 8 9 io 11 12 AA BA MA/MS PhD 
Your spouse: 1 2 3 4 5 6 7 , 8 0 10 11 12 AA BA MA/HS PhD 
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The...concep.t^of~--Career--Educafcion---einbod^ 

meanings. Would you please describe for us what Career Educa- 
tion means to you? 



In your opinion, what major benefits would students derive 
from a Career Education program? 

(a) elementary students; - 

(b) ji:. high school students: . 

^ - — ■ 

(c) jr. high school students: i 

If your children were participating in a Career Education program, 
what skills, knowledge and attitudes would you* want them to acquire' 

(a) skills: 

(b) knowledge : • . 

(c) acticudes: ' ■ * 

When you described skills, knowledge and attitudes above, did you 
:! ive li particular grade level in mind when each would be acquired? 

^'••■""ir yeH;;:what grade "level': " 
(a) skill ^ 

(L) knov/ledge • - • " 

ic) attitude 

. r-r opinion, what is tne difference between a Career Education 
,.; and a ' st^>ndard" school program? 



196 



Whac role^ or part, do-you feel the community should have in 

Jl-.i:jaxLejexJBd.ucat ion., 



I I Provide resource speakers 

|~ Provide employment 

I I Provide work observation , stations 

I j Set goals for the program 

I I Other (specify; 



What do you feel should- be your role in a Career Education 
curriculum? 

I j Service as a resource person i 

I I Insure that own child understands family occupations 

Develop understanding of need for shared family 
responsibility 

Q Assist students in understanding wide variety of career 
choices 

I I Work closely with schools in developing career programs 

I \ , Other ( specify :^ 

f - 

I 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Palls ^ Montana 
1974 

Evaluation Questionnaire 
Labor Representatives 



Form I 



J' 



1. Are you aware of the Career Education Project currently opera- 
tional in the Great Falls schools? 

KU yes • . 

No ^ — ■ 



^If no, would you like to have descriptive information 
about the project? 

LH Yes J. ^ 

D No ' 

_^ If yes, what do you perceive as the major purposes of 
the project? 



(a) 



(b)^ 
(c) 



2r iVa^ious a^ operati ons wil l plac e students JLn _a 

variety 6f work- type situation's^ i.e. / work observation, short" 
term work experiences, etc. Do you perceive any problems with 
students engaging in such experiences from your point of view? 



Yes 



I \ No 

r 

^ If yes, what problems will be existant? 

h ■ ' •■ 

— (a) . 

(b) . 
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(c) 



" (d) , • . ' ' 

Do any of the problems you listed have legal basis, i.e., 
will students working on a short-term basis violate anv 
state or federal laws? 



|-Q Yes 

□ . NO 



If yes, which laws? 



'(a) 
(b); 
(c) 
. (d) 



3. Are you aware of any union policies or rules which may have an 
effect upon student work experience and about which the project 
should be cognizant? • 

□ No . • 

1» If yes, would you please list or describe them? 

• • (a) • . 

, (b) 



(d) 



Do you feel that a focus upon career education can be beneficial 
to students? 

□ no : ' ' 

' >If .no, why not? 



ERIC 
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If yes/ in what ways? 



3 



I ■ ■■ 

5, What do ycu believe would be the most effective strategy for 
the project to keep you informed about their activities? 



\ " ■ • ' ■ 

6. In what ways do you feel the project and unions should interact/ 
i,e. , adopt a mutually supportive posture? 

— . ., . ^ __ ^ 



ERIC 



\ 

\ 



7. In what ways do you feel union^s could best support the following 
activities of the project? \ 

(3) Cooperative work-experienc6 : 



\ 

I f I don't know what this m^eans. 

. \ . 

(b) Work-observation program; \ 



\ 



I [ I don't know what this meansy 



(c) Teacher-training : 



\ 



I ■ I I don't know what this means, 
(d) Proi^iding resource speakers: , 



f J I don't know what this means. 

200 ' 



EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Palls Public Schools 
Great Falls, Montana 
1974 

Evaluation Questionnaire 

Employers 
Form I 



Type of business 



Number of permanent^ full-time employees: 
Years in present business: 



EKLC 



In what ways are you currently working with the Great Falls 
public schools? (Check all appropriate spaces,) 

I I Student employees 

jH] student observers ' , / 

□ Speak/make presentations to classes 

LU Other (please specify: ^ j 

Why did you agree ^to accept students (of any class) at your 
place of business? . ^ 

I I Needed part-time help 

l_l Student possessed necessary skills 

d Concern for students . . 

a Concern about the labor supply for your business 

Concern for the community 
Q Other (please specify: \ 
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•3. Listed below are the objectives of the Career Education Project 

in the Great Falls School District . Would you- please rate'' each ^ 
— ---- objectdbve-^on-the-'f olio^^ — ■ — ^7, '"^-^ — — ' 

(a) . Shpuld it be included in a Career Education program? 

(b) How important is the objective? 

(c) To what extent is it presently being attained ? 

(d) Would you be willing to participate in activities, 
oriented toward its attainment? 





(a) 


1 (b)^' 


(c) 


(d^ 


Project Objectives 


Should be included 


IMPORTANCE 
H = Very 
L = Low 


E-i- 

^ (U <d Tfl 

<: , 0) (t) 
w If 11/ 
0. 1 


1 Willing to 

1 Participate? " • 




Yes 


No 


H 


A 


L 


H 


A 


t 


Yes 


1 NO 


Facilitate students" finding 
satisfaction in employment 
upon leaving school 














/ • 






i 


Students are able to make 
.decisions regarding further 
education or training. 




















f 

! 


Students acguire useful levels 
of self-awareness of innate and 
acquired abilities, preferences 
and potentials. 


















■ ■ 


i 

^ \ 


Students poss<:2ss requisite 
skills to make quality de- 
cisions about careers. 
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Project Objectives 



Students be familiar with the 
values of a work-oriented 
society. 



Students accept the values of 
a work-oriented society. 



p 
o 



(b) 



u 



o 

H 



H II 



Yes 



Students find work meaningful' 
and satisfying* 



Each student tinderstands and 
accepts himself* 



Students who so desire may 
become prepared for employ- 
ment in a specialized job 
area. 



No I H I A IX, 



P 



(c) 



Ft 



2; 

< 

Eh 



0) S3 CO 

rd -P O^ 

P O 

(U CO m 



^ II II 

CQ 

g » 1^ 

04 



(d) 



o 

4J 



H 



0) 
O 

•H 



Yes 



No 



Each student is able to under- 
stand and form meaningful 
employer-employee relation- 
ships. 



i 



tach student develops an 
•"acceptablG" job attitude, 



Students are capable of 
effective occupational 
planning. 

Each student is aware of 
relevant factors to be 
considered in career de- 



Students manifest career 
awareness^ as demonstrated 
by their ;ncv ledge about 
Ai*ailable r:aroer options. 
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Projocfc Objectives 


(a) 


(b) 


(c) 






Should be included 


• IMPORTANCE 
H = Very 
L = Low 


PRESENT ATTAINMENT 
H Adequate 
L = Less than 
adequate 


Willing to 
Pcrticipate? 




Yes 


No 


H 1 A L 


H 


A |l 


Yes 


No I 


Students are capable of inde- 
pendent learning. 






















1 


Students are able to exercise 
responsible judgment in career 
planning and choice. 






















Students have available to them 
necessary resources to develop 
marketable vocation skills. 






















1 


Each s^tudent develops effective 
work habits. 






















Each student has an understand- 
ing of adjustment to societal 
changes* 




















1 




Students demonstrate an accept- 
able attitude toward the 
^^World of Work." 






















Services are provided wiiich 
enable students to ultimately 
find meaningful^ satisfying 
work. 




















i 


Ensure that each student is 
able to acquire desired 
[ occupational sKa lis. 






















;.2VJLd£r-.,.r.crc:L>exative,..„„wor . 






















[ exper .... r,cc f or students to 
] explore *'ke/" occupational 
1 ^feas* 
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(a) 


(b) 


(c) 


(d) 


1 Should be included 


IMPORTANCE 
H - Very 
L = Low 


2 Q) nj 

H 4J ^ 

U) w rj 
M II 11 


0 0^ 

c: »j 

•r( 

m n 
rH 


Yes 


No 


H 


A 


L 


U 


A 


L 


Yes 






! Establish and operate career 
information centers for student 






















Provide a prociram of work ex- 
perience as a jtudent option. 






















Provide a pio^jram of work ob- 
servation ar \ student option. 
















i 






Coordinate omt'loyment of 
students wit bin the business 
coniamunity. 
















i 






Establish and operate a student 
employment center. 






















Use resources from within the 
community to develop student 
understandings of the "World 
of Work." 




















Provide the type of placement 
service which enables students 
to satisfy economic needs. 






















Establish a career education 

^Ti*^*"! niii"»fn which orocirosses 

fron career awareness through 
c ^rr ^orat i of oc. "upations to 
iJf v^** Icpr.cKt ot occupational 






























._ 
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V^hat do you 'believe should be the major goals and/or 
purposes for a career education project? 



(a) 



(I) 



(c). 



As an employer, what do you perceive as the major con- 
tribution you can make toward attainment of the goals 
you listed? 

(a) ' . 



(b) 



(c) 
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EXmPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Falls, Montana 59^03 

Evaluation Questionnaire 

Employers 
Form II 

Listed bolow are several concepts which may be considered components 
of a Career Education C;irriculum. For each concept, would you please 
answer four questions by checking the appropriate space(s): 

1. Should the concept be included in a career education 
curriculum? 

2. How important is the concept? 

3. To whet extent can the concept presently be observed 
in the curriculum? 

k. To what extent, or degree, should you be responsible 
for assisting students to attain this concept? 







Part of a Career 
Education ^ 
Curriculum? 


How IMPORTANT is 
this concept? ^ 


To what extent can 
the concept 
PRESENTLY be ^ ^ 
OBSERVED in the 
curriculum? 


How RESPONSIBLE 

should you be 

for the attain- -p- 

ment of this 

concept? 


4> 

a. 

r 1 

O tl 

to 

O 4^ 
B 

0) O 

a> JO 


■ 


Cnreor Kiucnt^ion Concopts 




No 


Very 


Avo 


Not 


A 

[}re«t 
Deal 


%Some 


Not 
At 
All 


Pully 


Some 


None 




Stuients be familiar 
with the values of a 
Work-oriented society. 
























: 

I 




Students accept the 
values of a work- 
oriented society. 
























r 


[ 
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Career Education Concepts 



Students find work both 
meaningful and satisfy- 
ing. 



Students under jstand work 
as effort which produces 
benefit to self and 
others. 



Each student understands 
and accepts hiaself . 



Through understanding 
and acceptance of self, 
the student is able to 
live effectively in 
society. 



Each individual is able 
to resolve his concerns. 



Each student possesses 
information about his 
Innate and acquired 
abilities, capabilities,' 
preferences, and poten- 
tials. 



Each student possesses 
knowledge about specific 
occupations . 



Students who so desire may 
become prepared for em- 



piloymcnt in a specialized 
job area. 



U 

o 
O 



4 



4^ 
OS 

:^ u 
a, w o 



o 



Yes 



No 



o 



a 

O 

a 
o 
o 



Very 



Ave ' Not 



o 
a 

0) 

H 
Q) 

x: 
:» 

o 

1H 



0) 



a, 
o 

O W 
CO , . 

<D W CO 
^ CQ 
4^ O, O 



A 

Great 
Deal 



Some 



Not 
At 
All 



w JL 

CO 4^ 

s: r:^ 4^ 

p p OJ 



CO 



4^ 



0) «M 
'tl O 04 

rH 43 m 



:» o ^4 
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W CO <M 



0 6 



i 



ully Some 



None 
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Part of a Career 
Education ^ 
Curriciilun? 


1 

How IMPORTANT is 
this concept? ^ 


To whax extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
* curriculum? 


How RESPONSIBLE 

should you be 

for the attain- 4r- 

ment of this 

concept? 


Need more Info 
about this concept. *^ 


Career Education Concepts 


Yes 


No 


Very 


Ave 


Not, 


A 

^Ireat 
Deal 


Some 


Not 
At 
All 


Fully 


Some 


None 




Each student, develops an 
"acceptable" job atti- 
tude . 


























Each student is familiar 
with occupational classi- 
fications . 


























Each student is aware of 
relevant factors to be 
considered in career 
decision making. 



























Students are capable of 
effective ^occupational 
planning . 
















• 










Students manifest careor 
awareness as demonstrated 
by their knovled about 
available career options. 


























Students are able to 
utilize ceivee^ informa- 
tion in cluster explora- 
tion experiences. 


























Students are able to use 
knowledge about career 
concepts in the process 
of making career deci- 
sions. 


























Shudf*nhQ at*** f^nriAKTo r\f* 




J 






















rndbpendent lea^^ ^ 
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Part of a Career 
Education , ^ 
Curriculum? 




How IMPORTANT is 
this concept? ^ 


To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
■ curriculum? 


How RESPONSIBLE 

should you be 

for the attain- ^ 

ment of this 

concept? 


Need more Info 
about this concept. 


Career Education Concepts 


Yes 


r ] 

No 


Very 


Ave 


Not 


A 

Sreat 
Deal 


Some 


Not ^ 

At 

All 


Fully 


Some 


None 




Students are able to re- 
late studies within the 
general curriculiun to 
their career interests* 


























Students are able to 
exercise responsible 
judgement in career 
planning and choice* 






1 




















Eac^i student under- 
statids his family t 
avocational, citizen, and 
economic roles in life. 


























Eaci3 student is capable, 
of utilizing information 
gained from work obser- - 
vaticn in learning about 
careers, expanding his 
knowledge about available 
cfitreer options, and in 
making career choices. 


















■ ■» 








Provide those experiences 
which will enablt^ stu- 
dents to ultima'toly find 
meaningfiil, satisfying 
work. 


























Design and provide those 
experiences which will 
enable each student to 
understand- himself, 




























accept himself 7" and "live " 
effectively in society. 












•> 
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Part of a Career 
Education ^ 
Curriculxim? 


. 1 

How IMPORTANT is 
this concept? ^ 


To what extent car. 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
curriculum? 


' How RESPONSIBLE 
should 70U be 
for the attain- ^ 
ment of this 
concept? 


Need more Info 
about' this concept. 


Career Education Concepts 


Yes 


No 


Very 


Ave 


Nat 


A 

Great 
Deal 


Some 


Not 
At 
All 


?ully 


Some 


None 




Provide those services 
which will enable stu- 
dents to acquire infor- 
mation about their in- 
nate and acquired abili- 
ties, capabili ti es , 
preferences, and 
potentials . 


























Establish those services 
and experiences which will 
enable each student to 
acquire information about 
the world of work. 


























Design and provide those ^ 
experience^ which enable 
students who so desire to 
prepare for a 3pecJ.ali2ed 
job area. 


























■Facilitate student's un- 
derstanding the impor- 
tance of re-training or 
up-grading of occupa- 
* tional skills. 


























Insure that each studant 
is able to acquire de- 
. sired occupational skills. 


























Provide cooperative work 
experiences for those 
students who elect to 


























par tictpate"7i"n*" such 
experiences. 
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Career Education Concepts 



0) 
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a- 
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Very 



Ave 



Not 



A 

Sreat 
Deal 
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4:3 cq = 
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Some 



Not 

At 

All 



M 
CO 

o 
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CO 

o 



I 
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o cd 

O Pi 

ja o 



CQ 
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o 
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-p 

o 
o 
o c 
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o -P 
<D X> 

Sz: (d 



'ully 



Some 



None 



Provide opportunities for 
students to explore "key" 
occupational areas-. 



Establish a career edu- 
cation continuum, pro- 
gressing from career 
awareness through explora- 
tion of occupations to 
development of occupa- 
tional skills. 



Establish and operate 
career information 
centers, for student use. 



Provide in-service train- 
ing for professional . 
staff in the area of 
career education. 



Provide a program of 
work experience as a 
student option. 



Provide a program of 
work observatio^n as a 
Gtudent optior • 
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EXEMPLARY PROJECT IN CAREER EDUCATION 

Great Falls Public Schools 
Great Palis, Montana 
1974 

Evaluation Questionnaire 

Employers 
Form III 



Type of business: ' 

Number of permanent, full-time employees: 
Years in present business: 



Did you contact the school coordinator when attempting to employ 
a cooperative work experieince student? 

I i No ^ If no, why not? 

LJ I have no such students in my employ. 

> If yes, why did you contact the school coordinator? ^ 



2- What do you consider to be the most important skills an employee 
should possess? 

(a) 

(b) [ 

(c) >j . ^ : 
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/ 



/ 



1^ If no, what appear to be their major deficiencies? 



If yes, what do you find to be their major attributes? 



When 
Such 


do you Have the greatest 
as high school students? 


need for part-time employees. 


□ 


8 :00 am - 12:00 n 




□ 


12:00 n - 3:00 pm 




a 


3:00 pm - 6:00 pm 




D 


6:00 pm - 9:00 pm 




a 


9:00 pm — Later 




. As an 


employer / what are your 


gifeatest needs relative to each 



the following? 



(a) locating part-time, employees: 



(b) training part-time employees: 



(c)' quality of work of part-time employees: 



(d) other (please specify: 



What types of school services wolrld best satisfy the "needs" you 

J^-^JOktiJl^ " ■ 



(a) locating part-time employees: 



(b) training part-time employees: 



(c) quality of work of part-time ext5>loyees: 



(d) other (please specify: 



7. How many full- and part-time en^Dloyeee do you presently have? 

(a) full-time: 

(b) part-time: Number of part-time who are high 

school students: 



.8. How many of the positions in your business require: 
(a) college degree: 



(b) technical training: 



(c) high school diploma: 



(d) less than high school diploma: 



^ 9. What procedure do you typically follow in locating and employing 
part-time employees? ^ ► ^ 

O Contact the schools (who? : ) . 

O Employee contacts T^. ■ ' 

LZI Student contacts 

t [ State employment service 

I I Other (please describe: 



) 



\ 

\ 



10. If the schools had a placemen t/employxnent service, would you use it? 
fd Yes 

:f no, why not? 



cn No 



If yes, how could it BEST serve your needs? 

• r ■ • 

— ZT5-^ — 
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11. Do you feel that the schools should conduct an employee 
follow-up program as a part of placement/employment pro- 
cedures? 

Yes 
P NO 

V If yes, which of the following. do you feel should 

be included in such follow-up studies? 

Relevance of school curriculxm 

□ Meaningfulness of school curriculum 

(Ij Documentation of employee problems 

LH Number of different positions within a given 
time 

[Z] Continued placement/employment service 
[U Other (please specify; ) 



Coirments : 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Palls Public Schpols 
Great Falls, Montana 
1974 

Evaluation Questionnaire 

Work Coordinator 
^ Form _I___~~" 



1. In which of the following areas do you teach and supervise 
cooperative work students? 

Pj Distributive Education (D. E.) 
n Office Education (O. E.) 

□ Other (please specify :__ ' 

2. How many students do you supervise in the cooperative work 
experience program? 



q 


10 - 


15 . 


q 


. 31 


- 35 


□ 


16 - 


20 


□ 


36 


- 40 


a 


21 - 


25 


□ 


41 


- Over 


□ 


26 - 


30 









'3. What percentage of your students enroiled in the cooperative 
work experience program are also involved in club related 
activities? 

I I None' 

Cj 10 - 30% 

CL 31 - 50% . 

CD 51 - 70% 

□ 71 - 90% 

Q 91 - 100% 
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Ji^ Do_you-have_a-f onnaJ^tra i n ing- plan— you-fol low-in- coordinating 

student work experiences? 

P Yes 

No 



If no, what alternative do you enploy? 



If yeS/ what criteria did you en5>loy in the design and 
subsequent use of the plan? ' 



5. What percentage of the students enrolled in your cooperative 
work program are^ or have ^ held jobs congruent with their pro- 
fessed career choice? 



□ 


None 


Q 


. 31 


-40 


u 


10-20 ' 


U 


41 


- 50 


a 


21-30 


P 


51 


- Over 



6. What criteria do you employ to select students for the coopera- 
tive work program? (Check all appropriate spaces.) 

L] Have completed pre-requisite courses. (Name pre-requisites 

a Attendance (all-school) 

□ Attitude 

im Grades 

a Economic need |__| Student educational plans 

Q Career objectives Q Teacher recommendations 

O Employability Q Other (specify: ) 
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Z- Who has final responsibility for selection of students? 
- Q Teacher-coordinator 

( [ Administration (school) 

I j Counselor 

I [ Employer 

J^. other (specifyj „ 



8. Approximately what percentage of your time is spent in each of 
the following? 



% Coordination of cooperative students' experiences 



% Clerical duties 



% Club activities 



_% Coordinations within the business community 
% Preparation for classes 



% Public relations 



_% Teacher consultation 

In-service training 
_% Student counseling 
_% Scheduled classes 



9. What procedure (s) do you employ to recruit new training sites for 
the cooperative work program? 



0, Approximately how many training sites do you currently inventory, 
i.e,, how many are available for student placement? 



(Number) 



Coirenents: 
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What procedure do you employ to maintain training sites (stations) 
in your inventory? 



Wh^at__do_ y_Qu p_ejrc.eiye_as.„the_Juokt_jsigniJEica^ 
and effective operation of the cooperative work progretm? 
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jlXEHPLARY PROJECT W CAREER EDUCATION 

Great Falls Public Schools 
Great Falls, Montana 59^03 
197^ 

.Evaluation Questionnaire 

Work Coordinators 
Form II 



Listed below are _ several conoepts which may be considered coEiponents 
of a Career Education Curriculum. For each concept, would you please 
answer four questions by checking the appropriable space (s): 

1* Should the concept be included in a career education 
curriculmn? 

2. How important is the concept? 

3'. To what extent can the concept presently be observed 
in the cmrriculum? 

To what extent, or degree^ should you be responsible 
for assisting students to attain this concept? 





Part of a Career 
Education ^ 
Curriculum? 


2 . 

■ 

'< Cu 
E-» Q) 

g§ 

go. 

CO 

> *r4 

O JC 

t 


To what; extent can 
the conbeipt 
PRESEJITLYbe ^> 
OBSERVED in the 
- cur^-iculum? 


How RESPONSIBLE 

should you be 

for theUttain- ^ 

ment of] this 

concept? 


Need more Info 
about this concept. 


Career Education Concnpts 


Yes 


No 


Very 


Ave 


Not 


A 

CJro^it 
Deal 


Some 


Not , 
At 

An 


Fully 


Some 


None 


.» 


Sjtudents be familiar 
with the values of a 
work-oriented society. 












>» 


i 

> 












Stxidents accept the 
values of a work- • 
oriented society. 










p. 
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Career Education Concepts 



^No 



Very 



Ave 



Not 



A 

Sreat 
Deal 



Some 



Not 
At 
All 



Pully Some 



None 



Students find work both 
meaningful and satisfy- 
in/;?. 



Students understand work 
as effort which produces 
benefit to self and 
others. 



Each student understands? 
and accepts himse^-f . 



Through understanding 
and acceptance of jself , 
the student is able to 
live effectively in 
society. 



Each individual is able 
to resolve his concerns. 



Each-^student possesses 

information about his 
innate and acquired 
abilities, capabilities', 
preferences, and poten- 
tials . 



Each student possesses 
knowledge about specific 
occupations . 



Students who so desire may 
become prepared for em- 
ployment in a specialized 
job area. / 
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Part of a Career 
Education h 
Curriculum? 




2 

to 

-< cu 

a* o 
o c 

O} o 
to 

O J3 


To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the - 
curriculum? 


— . — 1 

How RESPONSIBLE ' 
should you be 
. for the attain- ' 4r 
ment of this 
concept? 


Need more Info 
about this concept. 


- 
















Career Education Concepts 


Yes 


No 


Very 


Ave 


Not- 


A 

3reai 
Deal 


Some 


Not 
At 

■All 


Fullj 


Some 


None 




Each student develops an 
"acceptable" job atti- 
tude . 


























Each student is familiar 
with occupational classi- 
Tications . 


























Each student is aware of ' 
relevant factors to be 
coneidiered in career 
'de:tision makii]g. 


























Students are capable of 
effective occupational 
planning • „ 


























Students manifest ceireer 
awareness as demonstrated 
by their knowled about 
available career options. 












• 










- 






Stiadents ore able to 
utilize career informa- 
tion in clujiter explora- 
tion experiences. 
















t 








Students are able to use 
knowledge about career 
concepts in the process 
of making career deci- 
sions. 
















c 












Stuc^nts are capable ^of 
independent learning. 
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Part of a Career 
Education ^ ^ 
Curriculum? 


^■ How IMPORTANT "is 
this concept? ^ 


To What extent can 
the Concept 
. PRESENTLY be ' ^ 
OBSERVED in the 
curriculum? 


' How RESPONSIBLE 
should you be 
for the attain- 
ment of this 
concept? 


cu 

o 
o c 

■a s 

05 

U ^ 

o 

Q 

o> o 


\ 

Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


A 

Sreat 
Deal 


Some 


Not 
At 
All 


;■ 

^ully 


Some 


None 




Students are able to re- 
late studies within the 
general curriculum to 
their career interests. 


























Students are able to 
exercise responsible 
judgement in career 
planning and choice. 
























/ 

/' 


Each student under- 
stands his family, 
nvocifional, citizen, ,and . 
economic roles in life. 














_ — . 




i 

: 








Each student is capable, 
of utilizing information 
gainied from work obser- 
vation in learning about 
careers, expanding his 
knowledge about available 

^^'F^^^L 

making career choices. 


















\ 

\ 






1 

: 


Provide those experiences 
which will enable stu- 
dents to ultimately find 
meaningful, satisfying 
work. 


























Pcsign and provide tihose 
experiences which will 
enable each student to 
understand himself, 
accept himself, and live 
effectively in society. 
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Part of a Career 
Education ^-' 
Curriculum? 


2 

r W 

. -a: a 

0^ 0 
0 c: 
a« 0 

.5 " 

m 

* 0 x: 


To what extent can 
the concept 
i PRESENTLY be <^ 
OBSERVED in the 
curriculum? 


. .How RESPONSIBLE 
1 should you be 

for the attain- xr 
! ment of this . 

conoept? • 


Need more Info 
about this concept. 


Career Education Conceptn 


Yes 


No 


Very 


! 

Aye 


Not 


A 

Clreat 
Deal 


Some 


Not 
All 


Fully 


Some 


None 




Provide those services 
which will enable stu- 
dents to acquire inTor- 
mation about their in- 
nate and acquired abili- 
ties, • capabilities, 
preferences, and 
potentials. 


























iito uauxxsn onose services 
and experiences which will 
enable each student to 
acquire information about 
the world of work. 










• 
















i^tjssxgn anu vx uvxae unose 
experiences which enable 
student/3 who so desire to 
preparf/ for a specialized 
job area-. 














- ' ■■ 








- 




• *^ J. L»a ue suucienu s un— 
~. dor standing the Impor- 
tance of re-training or 
'up-grading of occupa- 
oionax SKX.L±s . 


























Insure that each student 
is able to acquire de- 
sired occupational skills. 


























Provide cooperative work 
experiences for those 
student? who oiect to 
participate in such 
experiences. 
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Career Education Concepts 



Provide opportunities fror 
students to explore "key" 
occupational areas. 



No 



Eh 
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a, 
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Fully Some 



None 



Establish a career eda- 
cati on 'continuum , pro-, 
gressing frojn career 
awareness through explora 
tion o/? occupations to 
development of occupa- 
tional skills . 



Mtablish and operate 
career information 
centers for student use. 



Provide in-service train- 
ing for professional 
staff in the area of 
career ^education. 



Provide! a . program of 
work experience as. a 
student option. 



Provide a program of 
work observation as a 
student option. 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Publife Schools 
^ Gxeat.Xall8,„Montana _ 
1974 . 



Evaluation Questionnaire, 



Student 



Form I 



" . TH e"* plirp riTouB/^ 

factors listed. These factors describe student personal needs, school services, / 

organizational procedures and student personal goals. - / 

Please mairk an X in the box to the right, of each statement which describes how 
important the factor described is to you personally. 

Complete all of the items; don't leave any blank. Thank you for your assistance 
in ti\\s important effort. 



FACTORS 


Very 


Fairly 
High 


Moderate 


Fairly 
Weak 


Not 

At All 


1, To sele<:t more courses ,by myself. 










• 


2, To get same ''on-the-job" experiences. t 












3. To understand, accept, and^like myself «betiEi: 












4. To associate with a group of kids. 












To know how to apply for a Job. 












6. To finish school work & tests in the 

1 -. ..-,_alloLted -time... . 












?• To know more about my academic weaknesses. 












8. To know' how my interests relate to work.*" 












9. To know what I believe about God & 

religion. 












3, To know how to solve problems with my 

parents. 












L. To k...'^w how to interview for a job. 












T<>,k[ *\ (note about graduation requirements. 






i 






I. To : .ivv^ niv parr nrs know about my occupational. 

coals. 
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Degree of Per:s6nal Importance 



FACTORS ' * 


^'er> 
High 


f Fairly 
I High 


\ 1 Fairly 
Moderate 1 Weak 


1 Not * 
At All 




lA. Vi) learn how to irake decisions.' 






-.—J — 


— - 


0 


15. To know how to- act in a mi xpd afnim 


( 










16. To know how T can f inann* rnot-o ar^hr^r*! 






— H — - 

J 






17, To learn hnu fO Qfnriv h^a^^ot- • 




• 


-- — — — 












- , - 






IB. To find courses relt?vanf f-n mv fl1^ilVb 

wvvifcij^j ^cxcvdiil. LU Illy . 1> LI L U L CT « 












1^. To iiot help in findine a qiiTnm*»T- loh 






H — - 

J— 






20. To set my goals in life. 






■ ' ■ 


j - 




2l. To know how to eet a desirablp dflro 












'^^^ g^t more information on tradp Qrhnnic 













23. To participate in extra-curririii;iT--5 

ties. 








■ 




24, To talk to 3 counselor abnll^ ^i-^.r^ah i Aniai 
— ' • planninc. 


- 




— ~^ 

—1 [ 1 






25. To develop confidence in mvQpl f 












26. To hv <n better listener i"^ rp<jnnnH h^>^^or- 
— L to Others. 






" r — 1 

- — J — 1 






2 7. To get inoro i n I Orma t ion nn cn'K'Xc^of^a 






[ ■ J 


• 


■ Si 


28. To have teachers who underqtanH <^f-llHpn^c 




— 


' — — 1 


— — 


• 


?9. To have the school meet mv nppHQ a 

student. j 






4— [ 






»0. To have access to informatinn ahnnr r^n/^iiUa- 
■ ^_ tions. 






— A 






1. To understand more a-bniit qpv «nH i r^^/o 

S~ ^ ■ 












2. To develop friendships with oersons nF hnrh 
— ^- ^ sexea. 






' — r~T 






3. To ru'Uv ij r^'Qu 1 roment s of a career with my 
— — interests. 






— T — 






To i;n'.r ir; r .'.ici r i ;!od test scores inter- 
pre ted to me.v 
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Degree of Personal Importance 



r At* I \)H S 


^fery- 
rogn 


Fairly 
High 


r 

Moderate 


Fairl> 
Weak 


r Not 

At All 


1 


■'■ o ■ ■ 

35v To know liow my aptitudes relate to work. 




























36i To talk about personal concerns with a 

counselor. 














37'. To be able to independently state my 
' own views. 














38. To get help itx finding a job after 

- — — ~ &^raduat-i>on^; — — — 




• 










39. To be interested in my courses. 














AO. To know what jobs are available to me. 






i ' 








41. To have someone listen to me when I have a 

problem. 












« 


62. To be more tolerant of views with which I 

differ. 










/■ 




A3. To have classes on career planning. 




1 . 










.-*A. To liav^ classroom test scores that accurate- 
Iv reflect my knowledge about a content/course 

area. 












- • 


^-5v To have ci counselor explain what I can 

realistically achieve. 






1 






X 


A6. To got help in finding part-time work. 














A7. To learn how to tell others how I feel.. 














68. To not dislike my teachers. 








:. 


— 




69.. To get information about job opportunities. 















50. Tw^ have a counselor help me select courses. 










: — 




51. To know more ahout specific jobs. 














52. To know v lor,al richts & m.oral obligations. 














:'3l '.'o ret til unJr r s t.nrul adults. 














56. T.^ knvMv' vsiuTt v.>l«intcu^r work is available. 












♦ 



229 

-82- 

ERIC 



FACTORS 


Very 
High 


Fairl> 
High 


r 

Moderate 


Fairly 
'Weak 


Not 

At All 


55. To have ^ood study conditions at home. 












'.T). To find courses which are not too 

difficult. 












57. To know moreabout the world of work. 












58, To understanci more about the use and 
abuse 0 f a Icohol • 












3*^^. To more easily accept .others , 

f» •• <i . 1. 










' " ■— ' 


'^0. have teachers relate subject matter 

to occupations. 












To develop better relationships with my 

teachers. 






- • 






62. To know how my abilities relate to work. 












63. To understand how my feelings affect my 

behavior. 












64. To build bonds 'of trust with .people! . 












65. To .know what prior training is needed for 
' a particular profession. 












66. To have ticzcss to a counselor at the right 

tlrne. . 
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EXEMPLARY PROJECT IN CAREER EDUCATION 

Great Falls INihlic Schoola 
Great Falla, Montana 

197A 

Evaluation Questionnaire 

Students 
Form ll-A 



I. What is your present year (grade) in achool? 

□ 8 

□ ll (Junior) 



□ 7 

Dig (Sophomore) 
2. Wliat is your present age? 



(Freshmen) 
□ l2 (Senior) 



3. What is your sex? 
Q Female 
□ Ma lie 



^. What is your parent^ present occupation? 



Father: 
Mother : 



DcceasedQ 
DeceasedQ 



5* How many yr;irs ttavc you lived in Great Fells? 

CD less than 5 Qs - 10 

□ 5 - 7 Oil 

or more 

6, DurinR this past year, how vcdl^jui^j formal (scheduled) meetings have yo>y had with 
a school counselor which were WOT for scheduling purposes? 



f^ none 
□ l-3 



QlO or more 



□ a - 6 

□ 7-9 



If yon checked any of these boxes, please check below to indicate the general 
purposes of vour meetings. (May check more than one) 



Qciijpc ipl inary reasons 
Qfivmily ptoblenr?? 
Q€*«Jucat ionwl planning 
Qperjionnl problems 



Qgrade problems 
Qvocational planning 
Qlproblcms with teachers 

□ 
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1 . What does the term "Career Education" mean to you? 



8. Have you experienced what you would consider "Career Education" In any of 
voiir courses this year? 

□ no 

^If Yes, which ones? Describe the activity you considered to be 
^"Career Education". 



Course 



Desctfibe what happened 



(a) 
(b) 
(c) 
(d) 



9. A major concern throughout education is an attempt to ensure that school 
programs meet; students needs (are relevant), 

(a) Of the couraes In which you are presently enrolled, which do you feel 
best meets your needs? 



(b) What makes the course relevant? 



10. Which of your present co vVses do you feel best prepares you for the career you 
want to pursue? 



Name of Course: 



11* What is there about the course you named In (10) that causes you to feel It Is 
preparing you £or your career choice? 
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EXEMPLARY PROJECT IN CAKEER EDUCATION 

Great Fallt I'ubllc Schoola 
Great Falls, Montana 

1974 

Evaluation Quest lonna ire 

Studient 
Form II B 



What does the term 'Career Education" mean to you? 

Have you experienced what you would consider 'tareer Education" In any of 
your courses this year? 

□ no 

^If Yes, which ones? Describe the activity you considered to be In 
^Career Education? 



Describe what hap-pened; 

(b) 

(c) , ' 

(d) ' 
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3. Please check if you feel the following career education goals are 
present in the curriculiaa and, if so, indicate areas where changes 
are needed to better meet those goals. 



GOAL 


Present in 
in 


Present 


If present in the curriculum, please 
check below which areas need to be 
changed to assist you in reaching 
< the flroal. 


-p i 
o c 


Course 
Offerin^i 


- Work 
3 Experience 


Counseling 
3 Services 


I Teaching 
Methods 


Understand myself . 














Establish better 
relationships with 
others 














Acquire career 
information 














Develop a better 
understanding of 
our economic system 












— 


Increase my compe- 
tence as a purchaser 
of goods and services 














Know about skills 
required for a 
variety of careers 
















- 


Become better able 
to make good deci- 
sions 














Develop skills in- 
planning for a 
career 














Develop occupational 
oK±x::rQ In a career 
of my choosing 














Apply occupational* 
skill in a work 
experience 














Assistance in 
finding a job J 
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hXI-MPMRY PROJECT '^V CAREER EDlX/xTfu- 

C. cat Fall? PuMic Schooln 
• Great Fnlls, Montana 

Evaluation Questionnaire 

Student 
Form III 



\ 



I. What is voi:r preso;. „::c? (years) . 2. What is your sexV QFemal. nMafe 

What is vour p.-^r*;*/*^ occupation? 

\ < .. ■ 
Pother: ^ ; ne.-cr.scdD 

Mother ^ i)t>cea'?cdQ 

4. n*Tnv years h^y;* vou lived in Great Falls? 

Qless\than 2 years Q2 to 4 years 

D"' - 7y>r,ir5 , Qa to 10 years 

n I 1 or ti^iM c years 

>. iHtrin>; tMs pa.^t vvnr. how many formal (scheduled) meet inv'S ^.ivc* x iu h,^<» viln n 
«ihool CxMinFcK*:* whi<i^ vcic NOT for scheduling purposes? 

□ n..,.o ■ Dl - 3 

□ • - □? - 9 

1 «^ v>r nr»rc 

li yeu ch-ckii1 anv of tiics^> boxes, please ^heck below Lo indicate^ the ^t n. i 
puiposo** of ♦^^♦r mnainc;!?. (Way check more than one) 



PI }»sripnnnry reasons Q grade pioblcms 

Q ramily^ prohlems Q vocational plnrwiine 

Q educational planning Qproblems with teachers 

Q personal problems Qother 

e.^uniich w>t the following people were most Instrumental in your svlcrtfon of tlii; 
.CvV^perati vc program? 

[juachcr(s) Qsiater or brother 

□ coordinator □frlend(s) 

Qcounselor Qother 

Q former student of this program 



235 ' 




-88- 



s 



lad du/lng this past year, . l«e. 



. What work station assignments have you had dujbing this past year, . i.e. where did 
you worW and in what kind^f job? 

Place Type of Job 

(a) \ ' ^ 

(b) ■ ^ 

(c) l_ 

8. Did you have a specific reason for seeding a particular kind of work? 

/ 

•-^If Yes, why? ' 



How many times per month did your aupervlslng teacher observe and/or contact you 
on-the- lob ? 

□ None □less Chan once a month 

□ 1-2 . \ Oa '- 4 ' . 

or more • ' 

, 10/ How would you rate the relationship of your work station job to your career goals? 

Degree of relationship or * Very High Somewhat None 

relationship between work Q []] 

and career goals ^ 

11. How would you rate the relatidnahip of your work station job to this course? 

Degree of relationsWp between Very High Somewhat None 
'work and s chool courses " • " Q ' C3 jZJ 



12. Do you belong to any type. of career or professional organization such' as DECA, \ 
OEA, VICA, or a labor union? 

J . . ^ 

rDves , , 

□ no 

'"^If Yes, please name them: . \ - 



13. Can you provide us with any additional information about probedures employed in the 
worlv-ftxperience program which will make it a better program? (opinions & feelings 
sre ijoGl^ht in this question) T > 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public SchcxDls 
Great Falls^ Montana 
1974 

Evaluation Questionnaire 

Advisory Board 
Form I 



Name i Date : 

Title: . 



Address : 



1. How long have you served on the Advisory Council for the Great 
Falls Career Education Project? 

months 



2, How were you selected for membership? 
I \ Appointed (by whom: 



I [ Request (yours/someone else's: 

' — / 



3. Do you know why you are a member of this Advisory Council? 

Q Q No 

/If yes, please explain what you feel are your special 
/ qualifications: 

/ ■ : 

/ - 



/ 

/ 



Hot^ many meetings of the Advisory Council have you attended? 

(number) 



^^9^ '237 



Generally, how have you been notified that a meeting is to be 
held? ^ 

4 



Are you satisfied with the procedure employed to notify you of 
meetings? • 

□ Yes Q No ' • 



If no, what chcuiges in the procedure could 
you rec^omm^nd? \ 



Generally, how would you rate the following? 

High Average Low 

(a) USEFULNESS of the Advisory Council Q Q • Q 
Comments: 
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(b) 


EFFECTIVENESS of the Advisory Council 
Comments: 


a 




p 












(c) 


IMPORTANCE pf the Advisory Council 
Comments: 


□ 


p 


p 












(dr 


EFFICIENCY of the Advisory Council 
Comments: 


□ 


□ 


p 













What do you perceive as your role 


on the Advisory Council? 


(a) Provide information 


□ Yes 


\71 No 


Please explain: 






. ^ , ■ ■ 


(b) Make decisions: 


Q Yes 


□ NO 


Please explain: 








(c) Serve as a consultant 


□ Yes 


□ NO 


Please explain: 






■ . / . 


(d) Other (specify) : 


/ ■ 

/ 





9. Are you satisfied with your present ^role? 

□ / 

□ NO ' / ^ 

If not, what do you believe/ your role should be? 



What additional contribution can you make to the project? 



10. In your opinion, what effects have the Advisory Board had upon 
the project? 



(b) 
(c) 

T 
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J 

H. What would you predict as >OTURE Career Education needs in 
Great Falls? 

(a) Staff: 



(b) Programs: 



(c) Facilities: 



(d) Conmunity: 



(e) Other (specify) : 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Falls, Montana 59^03 
I97U 

Evaluation Questionnaire 

Advisory Board 
Form II 

Listed below are ijeveral concepts which may be considered components 
of a Career Education Curriculum. For each concept, would you please 
answer four questions by checking the appropriate space(s): 

1.. Should the concept be Included in a career education 
curriculum? , j * 

2. How important is the concept? ♦ , 

3^ ' To what extent can the concept presently be observed 
in the curriculum? 

k\ To what extent, or degree, should you be responsible 
i - for, assisting students to attain this concept? 



u 

0) 

u 

u 



O H 
O -P o 
■P O U 

u :s u 
(X. {2 o 



o c 

Ai o 



4-> 

0) 



-p 

CtJ 

o 

Eh 



0) 
-P 



0) M CO 
J3 Ct' CQ 
-P II4 O 



CO 4^ 

£3 a -P 

O O «J 

a. s 



J3 
-P 



CO 



O ^4 

^ ,0 



CD <M -P 



o o« 

<D O 
B O 



<D 
O 

o c 

^ 8 

o 4^ 
B 

43 
0) o 



Career Education Concophs 



Yes 



Students.be familiar 
with the values of a 
work-oriented society. 



Students accept the 
values of a work- 
oriented society • 



No 



Very 



Ave 



Not 



A 

^rea i 
Deal 



Some 



Not 
At 
All 



i^ully Some 



None 



EKLC 
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r 


?>>:;ct of a Career 
Education h 
Curriculum? 




How IMPORTANT is 
this concept? • 


To what extent can ^' 
the concept 
PRESENTLY be ^ ^ 
OBSERVED in the 
curriculum? 


How RESPONSIBLE 

should you be 

for the attain- ^ 

ment of this^ 

concept? 


Need more -'info 
about this concept. 




Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


A 

Cireat 
Deal 


Some 


Not 
At 
All 


Fully 


Some 


None 






Students find work both 
meaningful and satisfy- 
ing. 








■•■ 




















Students understand work 
as effort which produces 
benefit to self and 
others. 


























Each student understands 
and accepts himself. 


























Through understanding 
and acceptance of self ^ 
the student is able to 
live effectively in " 
society. 










• 


















Each ir'Jividual is able 
to resolve his concerns. 




























Each student posse^es 
information about his 
innate and acquired 
abilities, capabilities, 
preferences, and poten- 
tials. 














■ 


! 








• 


Each student possesses 
knowledge about specific 
occupations. 




























Students who so desire may 
become prepared for em- 
pioyment in a specialized 
Job area. 
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Part of a Career ' 
Education ^ 
Curriculuin? 




How IMPORTANT is 
this concept? 


. To what extent can 
the concept 
PRESENTLY be ^ 
OBSERVED in the 
curriculum? 


How RESPONSIBLE 

should you be 

for the attain-- ^ 

ment of this 

concept? 


Need more *inf o 
' about this concept. 


V 




Career Education Concepts 


Yes 


No 


Very 


Ave 


Not 


A^ 
Great 
Deal 


Some 


Not 
. At 
All 


Fully 


Some 


None 




Each student develops an 
"acceptable" job atti- 
tude . 


























Each student' is. familiar 
with occupationed classi- 
fications . 




• 














• 








Each student is aware of 
relevant factprs to be 
considered in career 
decision making. 






















\ 




Students are capable of 
effectiye occupationed 
planning. 








/ 




















Students manifest career 
awareness as demonstrated 
by their knowled about 
available career options. 




























Students are able to 
utilize career informa- 
tion in cluster explora- 
tion experiences. 


■ ? 




• 




















Students are able to use 
knowledge about career 
concepts in the process 
of making career deci- - 
sions. 


























Students are capable of 
independent learning. 
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Career Education Concepts 



a> 
u 

O -P O 

o 



Yes' 



No 



O 



0) 
O 

o 
o 

CO 

-p 



Very 



Ave 



Not 



a 
o 

-p 
X 

-p 
d 

> 
o 



0) 

Si 
o 

o w 

CO 

-P fl4 



0) 

-p 



> o 

CO § 
O O 



A 

Great 
Deal 



Some 



w 
cq 

CO 

• o 

CO 

B 



I 



0] 



<d -p 



o 

I ^ 
j:: o 

CO Cm 



-p 

Q) 



-P 

0) 
O 

o 
o 



a, 

0) 

o 

o a 

^ 8 



0) O 
0} JO 



Not 

At fully 
All 



Some 



None 



Students are able to re- 
late studies within the 
general curriculujn to 
their career interests. 



Students are able to 
exercise responsible 
judgement in fcareer 
planning and choice. 



Each, student under- 
stand his family, 
avocational, citizen, and. 
economic roles in life.' 



Each student is capable 
of utilizing information 



-gained~^ronrvorlrnjb^r=' 
vation in learning about 
careers , expanding^ his 
knowledge about available 
carber options, and ih 
making career choices. ^ 



i&rovide tHpse experiences 
whfch will enable stu- 
dents to ultimately find 
meaningful, , satisfying 
vorlc. 



Design and provide those 
experiences which will 
enable ..each student to 
understand himself, 
accept hims6lf , and live 
effectively in society. 
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Part of a Career 
Education . - ^ 
Curriculum? 


How IMPORTANT -is 
this concept? 

• 


To what extent can 
the concept - 
PRESENTLY be ^ 
OBSERVED in the 
curriculum? 


How RESPONSIBLE 
should you be . 
for the attain- xr 
ment of this 
concept? 


Need more *inf o 
about this concept. 


Career Bduication Concepts 


Yes 


No 


Very 


Ave 


Not 


A 

[Jreat 
Deal 


Some 


Not 
At 
All 


F-ully 


Some 


None 




Provide those services 
which v511 enable stu- 
dents to acquire infor- 
mation about their in- 
nate and acquired abili- 
ties, capabilities, 
preferences, and 
potentials . 


























Establish those services 
and experiences which will 
enable each student to 
. acquire information about 
the world of work. 


























Design and provide those 
experiences which enable 
students who so desire to 
prepare for a specialized 
job area. 


























Facilitate student's un- 
derstanding the impor- 
tune© of re-training or 
up-grading of occupa- 
tional skills. 


























Insure that each student 
Is able to acquire do- 
sired occupational skills • 


























Provide cooperative work 
experiences for those 
stuaents who elect to 
participate in such 
experiences. 
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Part of a Career 
Education h 
Curriculum? 




How IMPORTANT is 
this concept? ^ 

- 


To what extent can 
"the concept 
' PRESENTLY be oj 
bBSSRVED in the 
curriculum? . " 


— How RESPONSIBLE 
should you be 
for the attain- ^ 
ment of this . 
concept? ^ ' 


Need more 'Info 
about this concept. 


Career Education Concepts 


Xes 


No 


Very 


Ave 


Hot 


Sreat 


k 

^ome 


Not 
At 
All 


i 

Fully 


Some 


None 




Provide opportunities for 
students to explore "key" 
occupational areas. 










■ 
















Establish a career edu- 
cation continuum, pro- 
gressing from career 
' awareness through explora- 
tion of occupations to 
d.evelopment of occupa- 
tional skills. 










* 
















Establish and operate 
career information 
centers for student use. 


























!i Provide in-service train- 
ing for professional 
staff in the area of 
career education. 


























Provide a program of 
work. experience as a 

<9ttidfint n"n+".4 nn 


























Provide a program of 
work observation as a 
student option. 
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EXEMPLARY PROJECT IN CAREER EDUCATION 



Great Falls Public Schools 
Great Falls, Montana 
; 1974 

Evaluation Questionnaire 

Career Edurcatlon Specialists , , 

Form I 

Name: , Date; 

Present positiOii; . ■ , . ^_ 

• < ■ f. 

1. Would you please describe what you perceive as an "ideal" career 
education curriculum, including the desired: 

Ca) Goals:_^ 



(b) Program (content and activities) : 



(c) Material resources: 



(d) Personnel resources (staff) : 



EKLC 
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The literature is replete with such tenns as "career awareness," 
skill development, occupational awareness^ etc. Some confusion 
exists in the field because of conflicting definitions for 
these terms. Would, you please provide us with your definition 
for each of the following terms?; 



(a) Career awareness: 



(b) Self-awareness : 



(c) Career exploration: 



(d) Work experience: 



(e) Work observation: 



(f) Occupational preparation: 



^g) Career choice; 



(h) Satisfaction in a career choice: 



In what ways do you, in your work, operationally differentiate 
between career education arid: 

(a) vocational education? 



(b) general education? 
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4. In what ways do you feel career "^education can foster curricular 
relevance? 



5. What have you experienced as the most significant constraints to 
definition and integration of career education, relative to each 
of the following? 



(a) * teachers: 



(b) administrators (bldg. level) : 



(c) administrators (district/regional level) 



(d) curricular tradition: 



ve) conceptualization of career education: 



(f) community. £md/or other concerned publics: 



(g) curricular organization/structure: 



6. Each of the major 'project goals are listed on the following page. 
Would you please rate them relative to their congruence with 
what you perceive as the most pressing national needs? 
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Degree of Congruence 
Low Average \ - High 

(a) To develop a program which . Ll] [H = ) { 
: facilitates satisfactory placeirfent ; ' . 

of students in either 'eittployment/ 
education or training which per- 
mits the pursuit of a career 
choice or meets ^ real or pe^cbived 
need. ' . ^ , 

(b) To develop; and implement procedures []1 | [ | } 
• that enable students to explore and ' 

understand their unique character- ' 
istics and how these che^racteristics 
relate to defined life roles. 

(c) To facilitate integration of career □ □ □ 
educatipn concepts into the curricu- 

lum such, that each student may 
systematically develop those skills 
that* enable him to function in de- 
fijied life roles. 

(d) To develop procedures for planning, □ Q Q 
organizing, coordinating, c:lrecting 

and controlling staff , project, 
district and coromvmity resources to 
ensure the adoption of project goals. 

What general types of competencies, re^lative to career education, 
should be possessed by: 

(a) teachers? 



(b) consui^ants/ specialists? 
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8. What do you perceive as the greatest needs in career education: 
(a) at the present, tinie?_ 



(b) in the future (5 years)? 



9. Can you provide any additional information, relative to trends 
xn career education instructional strategies, resources ^re- 
, search, need for leaders, and need for teachers that will assist 
project staff in structuring future project activities? 

(a) Instructional strategies: • 



(b) 


Resources ' 


(staff) : 














I 


(c) 


Resources- 


(teachers) : 
















(d) 


Resources 


(materials) : 


9 








r. / 


w 





(e) Research: 



(f) Cutrricular structure: 



10. Can you provide the project staff with any other perceptions which 
will facilitate their efforts to define and integrate career educa- 
tion? 
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EXEMPLARY PROJECT IN CAREER. EDUCATION 



Great Falls Public Schools 
Great Falls, Montana 
1974 

Evaluation Questionnaire 

Career Education Specialists 
Form III 

Name J ^ ' Date: 

Present position: ' ' - 



Numerous .definitions have been proposed for the concept of 
career education. Would you please provide us with the 
defihition which you employ in your work? 




/ 



/ 



Can you provide us with a listing of schools or agencies who have 
effectively translated this definition into operational programs? 

I I No, I cannot. 

I I ' YeSr the following have: 

(a ) . " • • . 

, (b) _^ ■ , 

(c) ■ , 

(d) 

Would you please describe the most effective strategies you have 
observed, relative to: 

(a) development of ^career education curriculum? 
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(b) integration of career education into an established 
curriculxim? 



(c) development of the counselor's role , in career education? 



(d) involving the coiranunity ; 



(e) student work observation; 



(f) student work experience: 



V 



(g) student employment : < 



(h) inter-agency coordination: 



What do ycu perceive as the most, important need in United States 
education which can be satisfied by career education activities? 
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What are the most productive career education project strategies 
you .have observed in relation to: 



(a) elementary curriculum development? 



(b) secondary curriculum development? 



r 

(c) Student placement (in the generic sense)? 



(d) school staff devislopmeht? 



(e) project management? 



T 
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Great Falls Public Schocls 
Great Falls, Moiitana • 



ERIC 



ACTION INVENTORY 
Student 
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Career Education Project 



Great Falls Public Schools 
Career Education Project 
ACTION INVENTORY 



The purpose of this instrument is to determine the MEANING of certain 
things by having you rate them against a series of descriptive scales In 
completing this inventory, please make your ratings of what these things • 
mean to YOU. 

On each page of this booklet you will find a different concept to' be 
rated (judged) and beneath it a set of scales. You are to rate the concent 
on each of these scales, -in order. 

i-« « concept at the top of the page is VERY closely related 

to one end of the scale, place your check-mark a,s follows: 

GOOD JC_: : : : : 'j BAD 

or , . . ' ■ .. 

' ' - GOOD : , : : : : v BAD ' 



If you feel tfae concept is QUITE closely related to one or the other 
end of the scale fbuit not extremely) , you should place your check-raark as 
follows: 

GiWD :_X_: : : : : , BAD 

or ■ 

GOOD : " ■ : - : : :_L.-_ ^ 

If the concept seems only SLIGHTLY related to one side as' opposed to 
the other side (but is not NEUTRAL), then you should check as follows: 

/ - ■ ■ 
GOOD : : X : : BAD 

■ or ' i 

GOOD : : : : X : : BAD 
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The direction toward which you place your checTc, of coursie, .depends* 
upon which of the twoj ends of the scale seem most characteristic of the 
concept you are judging/ 

If you consider the concept to be NEUTRAL on the scale - both sides 
of the scale seem to be equally asspciated with the concept, then you 
should place your check-mark in the middle space. This type of feeling 
should seldom occur. 

GOOD : JL- • BAD 

Consider these examples: 

- TEACHING METOODS 



Very Quite Slightly Neutral Slightly Quite Very 
GOOD : X ; : : : • BAD 

fti this case, teaching methods were felt to be quite good. 



SCHOOL CLASSROOMS 

V Q S N S Q V 
Meaningful : X : : :^ : " Meaningless 

This example shows that school classroons felt to^be slightly 

meaningful . „ 

TEXTBOOK MEMORIZING 

- V Q S N S Q V 
Meaningful : : : : : Meaningless 

In this case, memorizing textbook passages was rated as very meaningless 

IT IS IMPORTANT THAT YOU: 

(1) Place your check-mark in the-middle of the space^,_not on the 
boundaries . 

this not this 
: X : : : : X : 

(2) Be sure you check every scale for every concept - DO NOT OMIT ANY ! 

(3) Never put more than one check -mark on a single scale. 



Sometimes you may, feel as though you have^ checked the same item twice 
on the inventory. This will hot be the case*, so DO NOT LOOK BACK AND FORTH 
through the items. 

MAKE EACH ITEM A' SEPARATE AND INDEPENDENT JUDGEMENT /' 

Work at a fairly high speed through this inventory. Do not worry 
or puzzle over individual items. It is your FIRST IMPRESSIONS, the 
IMMEDIATE FEELINGS you have about the items that we want to record and 
which are of use in this measurement procedure. On the other hand, please 
do not be careless; as we want your true impressions, 

^ THIS IS .. NOT A TEST ^ THERE ARE NO^ RIGHT OR WRONG ANSWERS 

At this time, go. to the first concept on the following page. You 
should complete all of the items within twenty minutes. 



HOW TO LOOK FOR WORK 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely. 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Superior 
Important 
Wrong 

Unsatisfactory 
Timely 



: Meaningful 

: Useless 

f Progressive 

Disapprove 
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PART TIME WORK 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Superior 
Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



JOB INFOWUIION 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Appro-; c 




































































i 














































1 
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Bad 

Superior 

In^ortant 

Wrong 



Meaningful 
Useless 
Progressive 
Disapprove 
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SCHOOL EMPLOYME^fr OFFICE 



Inferior 
Unimportant 
Right 
Satisfactory 

Untimely 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Superior 
Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



EMPtOYERS 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Superior 
^ Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 
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ADDITIONAL TRAINING 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



_ Bad 

Superior 

Important 
Wrong 

Unsatisfactory 

Timely 

MeaniiTi^ful 

Useless 

progressive 

Disapprove 



DECISIONS ABOUT MY 'FUTURE 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
(Untimely 
Meaningless 
Useful 
Rcg;cssivc 
Approve 



Bad 

Superior 

InpurLont 

Vfrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



261 

-113- 



inE SCHOOL TESTING PROGRAM 



Good 






Inferior : 






Unimportant : 






Right 






Satisfactory 






UntiocS/ * 






Meaningless : 




:j 


Useful : 






Regressive 






Approve :::::: 



Bad 

Superior 
Important 
Krong 

Uisatisfactory 
Tinely 
Meaningful 
Useless 
Progressive 
Disapprove 



LEARNING ABOUT MYSELF 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Superior 
^ Important 
^ Wrong 

^ Unsatisfactory 
Timely 
Meaningful 
Useless 
Progressive 
Disapprove 
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GETiING ALONG WITH OTHERS 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 

Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Diciapprove 



MYSELF AS EMPLOYEE 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 

Superior 

Important 

Wrong 



Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 
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Cood 
Inferior 
UiumportJint 
Right 
Satisfactoi/ 
i>rr?.imely 
teaningles:^ 
Useful 
Regressive 
Approve 



I- 



^ Bad V 
^ Superior 
_ Important 
Wrong 

Unsatisfactory 

Timely 

Mearifi'ngful 

Useless 

Progressive 

Disapprove 



FAMILY MEMBERSHIP 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 

Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progt'essive 

Disapprove 
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SCHOOL SUBJECTS 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaning I'ers 
Useful 
Regressive 
Approve 



Bad ; 
Supefior 
Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

/ / 
Prj^grcssive 

Disapprove 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



OCCUPATIONAL TRAINING 



^ Bad 

^;Superior 
j Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



CAREER EDUCATION 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 

_ Superior 
Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



REQUIRED COURSES 



Good 
Inferior 
UniiDportant 
Right 
iJatisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



. Bad 

^ Superior 
^ Important 
_ Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useles.r^ 

Progressive 

Disapprove 
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COURSE IN CAREERS 



Gbodr 
Inferior 
Unimportant 
. Right 
Satisfactory 
Untimely 
Meaningless 
^ Useful 
Regressive 
Approve 



^ I5ad 

Superior 
; Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



KORK 



Goo^ 
Inferior 
Unimportant 
. Right 
Satisfactory 
Ihitimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 
^ Superior 
Important 
Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 
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EARNING AND MANAGING MONEY 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



_ Bad 

^ Superior 
Important 
^ Wrong 

^ Unsatisfactory 
Timely 
Meaningful 
Useless 
Progressive 
Disapprove 



GOING TO COLLEGE 



Good 
Inferior 
Unimportant 
Right 
Satisfiactory 
Untimely 
Meaningless 

Useful ^ 
Regressive 
Approve 



Bad 
_ Superior 
_ Important 
^ Wrong 

^ Unsatisfactory 
^ Timely 
^ Meaningful 

Useless 

Progressive 

Disapprove 
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RESPONDENT DATA 

Your responses to this instrument will be confidential. However, for 
us to understand the data, it is ncicessary to categorize respondents. 

Please prpyide the information requested below: 

Today !s date is : 



I am enrol lei in Grade : - 
My school iz: 



My Grade Point Average is: 



I have lived in Great Falls for ^ years. 

My parents occupation: Fathe r Mother 

I have held the following jobs:^ 
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Great Falls Public School 
Great Falls, Montana 



ACTION INVENTORY 
FORM A 



Career Education Project 



270 



Great Falls Public Schools 
Career Education Project . 
ACTld^l INVENTORY 

The purpose of this instrument is to detentine the MEANING of certain 
things by having you rate them against a series of descriptive scales In 
completing this inventory, please make your ratings of what these things 
mean to YOU, 

On each page of this booklet you will find a different concept to be^ 
rated (judged) and beneath it a set of scales. You are to rate the concept 
on each of these scales, in order. • ' 

If you feel the concept at the top of the page is VERY closely related 
to on? «nd of the, scale, place yc r check-mark as follows: 

GOOD -i : : : BAD 

or 

GOOD : : : : : BAD 



If you feel the concept is QUITE closely related to one or the other 
end of the scale (but hot extremely) , you should place your check-mark as 
follows: 



GOOD : X : : : : BAD 



or 

GOOD : : : : : X : BAD 



If the concept seems only SLIGHTLY related to one side as opposed to 
the other side (but is not NEUTRAL), then you should check as follows: 



GOOD : :Jc_: _: : : BAD 

or 

GOOD : : : : X : . : BAD 
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The direction toward which you place your check, of course, depends 
upon which of the two ends of the scale seem most characteristic of the 
concept you are judging. 

If you consider the concept to be NEUTRAL on the scale - both sides 
of the scale seem to be equally associated with the concept , then you 
should place your check-mark in the middle space. This type of feeling 
should seldom occur. 

GOOD : :_x_: : : BAD 

Consider these examples : 

TEACHING METHODS 

Very Quite Slightly Neutral - Slightly Quite Very 
GOOD : X : J _: ^, b^D 

In this case, teaching methods were felt to be quite good. 



SCHOOL CLASSROOMS 

V Q S S Q V 
Meaningful : : : ; Meaningless 

This example shows that school classrooms were felt to be sliehtlv 
meaningful. . » / 

TEXTiBOOK MEMORIZING 

V Q S N S Q V 
Meaningful : : : ; :_x_ Meaningless 



In this case, memorizing textbook passages was rated as very meaningle 
tT IS IMPORTANT THAT YOU: ., 

(1) Place your check -mark in the middle of the space, not on the 
boundaries. 

this not this 

(2) Be sure you check every scale for every concept - DO NOT OMIT A NY I 

(3) Never put more than one check -mark on a single scale. 
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Sometimes you may feel as though you have checked the s^jame item twice 
on the inventor/. This will not be the case, so DO NOT LOOK BACK AND FORTH 
through the items. 

MAKE EACH ITEM A SEPARATE AND INDEPENDENT JUDGEMENT ^ 

WorJc at a fairly high speed through this inventory. Do not worry 
or puzzle over individual items. It is your FIRST IMPRESSIONS, the 
IMMEDIATE FEELINGS you have about the items that we want to record and 
which are of use in this measurement procedure. On the other, hand, please 
do not be careless; as we want your true impressions* 

THIS IS NOT A TEST - THERE ARE NO RIGHT OR WRONG /iNSWERS 

At this time, go to the first concept otl the following page. You 
should complete all of the items within tw>?^<;y minutes. 



STUDENT EMPLCnMEirr 



Good 
Inferior 
Uhlmportant 
Right 
S«tisfrctory 
UntiMly 
Meaningless 

Useful ^ 
Regressive 
Approve 



•fid 

Superior 



^ Wrong 

^ Uisotiefi^ory 
^ Timely 

Meaningful 

Useless 

Frogressive 

Dis^prove 
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OK-Sn£ CARFf-R EXPERIENCE 



Good 

inferior 

Uiiaq)ortant 

Right 

Satisfactozy 

Untimely 

Nsaningless 

Usefiil 

Regressive 

Approve 



^ Superior 
^ ijqKnrtant 

Wrong 
^ Ubsatisfactory 

Tiselx 

Meaningful 

Useless 

Progressive 

Disi^rove 



COffTINUING EDUCATION 



'Good 
Inferior 
Ubiaportant 
Right 
Satisfactory 
Untiaely 
Meaningless ^ 
Useful ^ 
Regressive 
Approve 



_Bad 

_ Superior 
^ Important 
_ Ifrong 

_ Itasatisfactory 
^ Timely 
. Meaningful 
, Useless 

Progressive 

Disapprove 
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EMPLOYERS 



Bad 

Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive , 

Disapprove 



Good 

Inferior 

Uniaport^ant 

Right 

Satisfactory 

Untimely 

Heaninglesr 

l-3eful 

Regressive 

Approve 



CAREER EXPLORATION 



Ck>od 1 
Inferior ^ 
Unimportant _ 
Right _ 
Satisfactory _ 
Untimely _ 
Meaningless 
Useful _ 
Regressive _ 
Approve _ 



Bad 

Superior 

lB^>ortant 

ITrong 

Ibisatisfactory 

Timely 

Meanifigful 

Useless 

Progressive 

Disapprove 



275 



-126- 



OCCUPATIONAL AWARENESS 

Good : : : ; z ^ Bad 

Inferior * : • * » ' • Superior 

Unisportant : : : : : : laportant 

Right I ^: : : ; : Wrong 

Satisfactory ; ; : ; ; Unsatisfactory 

Untimely J : : : ; :^ Timely 

fbaningless ^ j: : : : ; : Meaningful 

Useful : ; : : : ; Useless 

Regressive : j : : : :^ Progressive 

Approve :^ : : : _ ; : Disapprove 



CAREER COUNSELLING 



Good : : : ^ : x 3aA 

Inferior r^^^ : : : : : Superior 

Utai»portant :^ : : : : . It^^^tBnt 

Right : : : : Wrong 

Satisfactory : : j _ laisatiti > ztoxy 

Untimely : : : v.^ : ^ : : Tioely 

Meaningless ^ : ' : : : Meaningful 

Useful : : : : : Uselo** 

Regressive : : : : : : Prc?gre«:sive 

Approve ; _ ; ; : ; ; Disapprove 
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STUDENT SELF-AMARENESS 



Good 
Inferior 
Unlnportant 
Right 
Satisfactory 
Itatioel/ 
Meanisigless 
Useful 
Regressive 
Approve 



Bad 

Sfxperior 

Iiqportant 

^ong 

Unsatisfactory 

Tiaely 

Meaningful 

Useless 

Progressive 

Disapprove 



PREPARATION FOR THE FUTURE 



' Good 
Inferior 
UiijBportant 
Right 
Satisfactory 
Untinely 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

^ Si^perior 

IflporiK^t 
^ Wrong 

Unsatisfactory 
. Tiaely 

Meaningful 

Useless 

Progressive 

Disapprove 
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CAREER EDUCATION RESOURCES 










• 




_ Superior 


Unimportant 




_ Important: 




* • • • ** ♦ J 


- — . ■ 
_ Wrong 


Satisfactory 




Ifcisatisfactory 


Untimslv 




_ Timely 






_ Meaningful 


W9 


— — — " ' ■ 


Useless 


Regressive* 


• • * • • • 

* * * • • 




Approve ^ 


> : : : ; : 


Disapprove 



FINANCIAL RESPONSIBILITY 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 

Useful ^ 
"regressive 
Approve 



- Bad 

_ Superior 
_ Import an i: 
^ Wrong y 
^ l/nsati,s:^ctory 

JTioely 

Meaningful 

Useless 

Progressive 

Dis:;?ipprove 
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/ 

/ 

/ 



Good 

/ / 

/Inferior 

Unimportant 

/ / . 

/ Right 
Satisfactory 
/ Untimely 
Meaningless 
' Useful 
/ Regressive 
Approve 



/ 

dignitV of work 



Bad 



Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

^ Meaningful 

Useless 

Progressive 

Disapprove 



I RESPONDENT' DATA 

I Your responses to this instrument will be confidential. However, for 
us jto understand the' data, it is necessary to categorize respondents* 

Please complete each of the appropriate sections below: 

Today's date is : 2.,, 

I am a : 



!~] Teacher (Grade : School : ^ 

( I Counselor (School :^ • 



Q Administrator (School 
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II, Demographic data 

Niifliber of years experience:^ 

Number of years in this district : 

Number of years in this building: 

Age: 20-25 Q 35-40 Q 50+ Q 
25-30 □ 40-45 Q 
30-25 □ . 45-50 Q 
II , Educational History 



College/University 


Degree(s) 
Received 


Year 

Received 


Major 


Minor 

































B. Teaching Responsiail:;ties 
I I (I) Elementary Teacher 
When 



-Vs?. ysaxs 
I I (2) Sfondary Teacher 



List all major course responsibilities, beginning with 
those you are presently teaching. 
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Course 


When 


No, years 





























School District Activities: 



Name of Committee 


Role (chairman, sec, member, 
etc.) 


Year(s) 
member 





















B. Other Activities 
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Great Falls Public Schoo 
Great Falls, Montana 



ACTION INVEmORY 
FORM B 



Career Education Project 
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Great Falls Public Schools 
Career Education Project 
ACTION INVENTORY 



The purpose of this instrument is to determine the MEANING of certai^^ 
things by having you rate them against a series of descriptive scales, in 
completing this inventory, please .^lake your ratings of what these things 
mean to YOU. 

On each page of this booklet you will find a different concept to be 
rated (judged) and beneath it a set of scales. You are to rate the concept 
on each of these scales, in order. 

If you feel the concept at the top of the page is VERY closely related 
to one end of th^ scale, place your check-mark as fdllows: 

GOOD X : : : : : : BAD 

or 

GOOD : : : : : : y BAD 



GOOD :_X_: : .. ; . g^j. 



or 

GOOD 



GOOD : :_x_: : : : BAD 



or 

GOOD : : ; x : 



BAO 
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The direction toward which you place your check, of course, depends 
U|>on which of the two ends of the scale seem most characteristic of the 
concept you are judging. 



. If you consider the concept to be NEUTRAL on the scale - both sides 
of the scale seem to be equally associated with the concept, then you 
should place your check-mark in the middle space. -This type of feeling 
should seldom occur. ? 

GOOD :_j ^: JC_- • • BAD 

Consider these examples: 

TEACHING METHODS 

Very Quite Slightly Neutral Slightly Quite Very 
GOOD : X : _: : : BAD 

In this case, teaching methods were felt to be quite good. 



SCHOOL CLASSROOMS 

V Q S N S Q V 
Meanin^;tul : :jc_: : ; : Meaningless 

This exaJTipie shows that, school classrooms were felt to be slichtlv 
meaningful. ^ 

TEXTBOOK MEMORIZING 

V Q S N S Q V . 
Meaningful : : : : : ^ : X Meaningless 

In this case, memorising textbook passages was rated as very meaningles 
T IS IMPORTANT TliAT YOU: 

(!) Place your check-mark in the middle of the space, not on the 
bouncK'iri OS . 

this not: this 

: X : : : : X: 



{2} Be sure you check every scale for every concept - DO NOT OMIT XNYl 
(3V Vcnor put mo'r^^ than one check-mark on a single scale. 
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Sometimes you may feel as thougii you have checked the same item twice 
, on the inventory. This will not be the case, so DO NOT LOOK BACK AND FORTH ' 
through the items. . 

MAKE EAQl ITEM A SEPARATE AND INDEPENDENT JUDGEMENT 

Work at a fairly high speed through this inventory. Do not worry 
or puzzle over individual items. It is your FIRST IMPRESSIOiNS, the 
IMMEDIATE FEELINGS you have about the items that we want to record and 
which are of use in this measurement procedure. On the other hand, please 
\o not be careless; as we want your true impressions. 

THIS IS NOT A TEST - THERE ARE NO RIGHT OR WRONG ANSWERS ^ 

At this ^ime, go to le first concept on the following page. You 
should complete all of the items within twenty minutes. 



STUDENT SATISFACTION IN WORK 



Good 
♦'Vfejrior 
UiJ uT.portant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful^ 
Regressive 
Approve 



Bad 



_ Superior 

Important 

Wrong 

Unsatisfactory 



_ Timely 
^ Meaningful 
_ Usel »ss 
^ Progressive 
_ Disapprove 
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3Tur£NT WORK EXPERIENCE 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
"Meaningless 
Useful 
Regressive 
Approve 



- Bad 

^ Superior 
^ Icpportant 

Wrong 
^ Ifiisatisfactory 

T^iely O 

Meaningful 

Useless 

Progressive 

Disapprove 



CAREER DECISION-MAKING 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful ^ 
Regressive 
Approve 
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_ Bad 

Superior 
_ Important 
Wrcng 

Unsatisfactory 

_ Timely 
_ Meaningful 
_ iJseless 
_ Progressive 
_ Disapprove 
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A PLANNED FUTURE 



Good 
fn fori or 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 

Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



CHOOSING A CAREER 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Rcgrcs'sive 
Approve 



Bad 

Superior 

Important 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 
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WORK-CURRICULUM RELATIONSHIP 



Good 
Inferior 
Unimportant 
Right 
Satisfactory 
Untimely- 
Meaningless 
Useful 
Regressive 
Approve 



^ Bad 

_ Superior 
^ Important 
^ Wrong 

_ Unsatisfactory 
^ Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



DEVELOPMENT OF AVOCATIONS 



Good 
in ferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 

Useful ^ 
Regressive 
Approve 



Bad 
_ Superior 
_ Important 
^ Wrong 

^ Unsatisfactory 
^ Timely 

Meaningful 

Useless 

Progressive 

Disapprove * 
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VOCATi: . PREPARATION 



Good 



Inferior 
Unimportant 
Right 
Satisfactory 
Untimcl/ 
Meaningless 
Useful 
Regi essive 
Approve 



Bad 

Superior 

Inportant 

Wrong 

Unsatisfactory 

Timely 

Meaningful 

Useless 

Progressive 

Disapprove 



SUBJECT MATTER RELEVANCE 



Goc»d 

Inferior 

■ • ■- V • ■ •-• 

' ifciinportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



_ Bad 

_ Superior 

^Important 

_ Wrong 

_ Unsatisfactory 

Timely 
^ Meaningful 

Useless 



Progressive 
Disapprove 
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A CAREER EDUCATION CURRICULUM 



Good 




Bad 








Inferior : 


= — = — •_• — 


/ Superior 


Unimportant 


_• . 


Important 


Right 


: : : : : 


Wrong 


Satisfactory : 


— • • • • 


Unsatisfactory 


Untimely 


— • • • — : — • • — 


Timely 


Meaningless 


: : : : : 


Meaningful 


Useful 




Useless 


Regressive 




Progressive 


Approve : 




Disapprove 



CITIZENSHIP RULES 



Good 
Inferior 
Unimportant 
Right 

Sat i sfactory 
Untimely 
Meaningless 
Useful 
Rot'i't'ssivc 
yipprovc 



_ Superior 
"Important 
Wrong 

Unsatisfactory 

_ Timely 
Meaningful 

_ Useles:; 
Progressive 
Disapprove ♦ 
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FAMILY ROLES 



Good 



Inferior 
Unimportant 
Right 
Satisfactory 
Untimely 
Meaningless 
Useful 
Regressive 
Approve 



Bad 



iperior 
iportant 
Wrong 

Uns ati5factory 
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Meaningful 

Useless 

Progressive 

Disapprove 



Right 
Satisfactory 

Untimely 

\ 
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'\ 

Useful 
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Approve 



RESPONSIBILITY FOR TEACHING CAREER EDUCATION 

Good 

Inferior 

Unimportant 



Bad 

Superior 
Important 
Wrong 

Unsatisfactory 
Timely 
Meaningful 
Useless 

Progressive 
Disapprove 
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RESPONDEhfT DATA 



Your responses to this instrument will be confidential. However, for 
us to understand- the data, it is necessary to categorize respondents. 

Please complete each of the appropriate sections below: 

Today's date is: . - 

I . I am a: 

1 } Teacher (Grade: School :^ 

( I Counselor (School :_^ 

I I Administrator (School :^ - 




ir 



rir 
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Demographic data 

Number of years experience: 



Number of years in this district : 

Number of years in this buiKt:ng: 
Age: 20-25 Q 35-40 [J 50* Q 
• 25-30 □ 40-45 □ 
30-25 □ 45-50 Q 



Co 1 1 ege/Un i vers i ty 


Degree (s) 
Received 


Year 

Received 


Major 


Minor 












I 


















-A 

1 
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B. Teaching Responsibilities 

(1) Elementary Teacher 



n 



When 



No. years 
(2) Secondary Teacher 



List all major course responsibilities, beginning with 
those you are presently teaching. 



Course 



When 



No. years 



1 



School District Activities: 



Uamo^^ Committee 


Role (chairman, sec, member, 
etc.) 


year(s)- 
member 





















B. Other • L;vi.tics; 
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A P P_E N D I X C 



PREFACE 



„ These edited versions of interim reports have been included 
to provide the reader with insight into the developmental nature 
of the project and with brief summaries of evaluation data and 
recommendations emergent from that data. \\!hose interested in the 
details of statistical treatments and analynes are referred to 
the unedited reports of June 30, 1974 and June 30, 1975. 
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First year interim report 

An Exemplary Career Education Program 
in the Great Falls Public Schools 



Great Falls Pubfic !?chools 
1100 Fourth Street South 
Gre^t Falls, Montana 59401 
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SUMMARY OF THE REPORT 



~--A*---^ime-Ferdoci -Covered —.^-^ — ^ — . r:^.- , 

July 1, 1973 to June 30, 1974. 

B. Goals and Results 

o 

The original proposal. for this project described numerous changes in 
student behavior to be effected by the project. The desired student out- 
comes, ranged from heightened awareness of career options at the elementary 
level to specific occupational skills at the post high school and adult 
levels. The continuum of knowledge and skills described was in close 
accord with the most widely published model of Career Edircation, 

However, achievement of the student outcomes described was predi- 
cated upon a- fully developed Career Education curriculum and the support 
mieclianism necessary to operationalize that curriculum. Neither of these 
conditions existed at the. time of initial project funding. Consequently 
project energies were focused upon development of those functions which 
would ultimately enable desired student outcomes to obtain. This made, 
necessary the establishment of a new developmental structure for the 
project. 

The four major areas subsequently addressed by the project were 
related, to (1) curricxilum development, (2) provision of necessary 
counseling services, (3) establishment of a functional placement program, 
and (4) the design of those management procedures which would incur 
efficient and effective operation of the total effort. Achievements of 
the project in this definition and development effort are? summarized 
below. • 

Goal 1; Curriculum Development . A great deal of progress was made 
during this first year in redefining district curriculum to more accu- 
rately reflect the philosophy of Career Education adopted by the project. 
This philosophy establishes a commitment to maximize curricular relevance 
for students at all levels, which in turn ?ias required that significant 
revision be made in curricular content and instructional strategies 
employed by teachers. Each of these concerns has been systematically 
addressed by spTecial groups functioning under project supervision. 

A most important and often overlooked consideration in effecting 
curricular revision is a precise identification of what career education 
emphasis currently exists within the curriculum. The intent in emphasiz- 
ing this' strategy for curriculat revision is to maximize benefits from 
these revision processes by initiating new activities at the level of 
current development. This factor has been carefully addressed by the 
project in numerous ways; such as identification of available material, • 
identifying staff perceptions of their roles, and determination of 
strategies currently employed which can most readily accommodate a 
Career Education 2mphasis, 
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Goal 2: Counseling Services ^ Much of the literature related to 
Career Education places strung emphasis upon student guidance and 
counseling at every instructional leval. This same emphasis is refli^^cted 
during this past year. Included among these efforts have been identifying 
counselor perceptions of their ^ roles in a Career Education program, design 
of career Information centers for use by students, experimental use of 
several tests to deterxt.lne which might provide the most u:seful counseling 
information, and deteraining s^jtudent perceptions of their most pressing 
counseling needs. The intent during the second project year will bfc to 
integrate a variety of counseling functions into a diffuse but precisely 
targeted counseling program. Plans for continuing the necessary data 
baseii to achieve this goal have? been established inuring this first vear 
of operation. 

Goal 3; Placement Service s. In many respects this goal of the pro- 
ject is one of the more critical, for it Includes much more than the 
title describes. For use within the project thij^ goal hao included such 
diverse concerns as establishing a functional work experience program, 
articulation of a post high school program, ar:d integration of services 
available from a variety of private and governiuental agencies throughout 
the community. 

Accomplishments of the project during the pa<^t year in relation to 
tKis goal have been excellent. Examples includo the following: 

I. An inventory of over 350 work experience stations has been 
established. 

2., Representatives from both private and government employment 
agencies have "set to discuss how they can each support the 
philosophy of Career Education. 

3* Various kinds of ^*r\ceds" studies have been completed in 
cooperation with the local Boy Scout Council. 

4. Representatives from labor organizations have been closely 
involved in development of an effective work experience 
program. 

5. Major constralnrs .to fully operatlonallze a comprehensive 
work experience program have been identified and ir4itial 

coping strategics have been designed. 

if 

A ;r< at deal of work remains to be done? in relation to this goal — 
primarily because of^tha sweeping 3\ature of the goal and the complexities 
of eifecting close community involvement. Hovrvcr, systematic progress 
ha5> been niade toward achieving the desired ends- 

Goal 4; Management . Management, by def imition, is a-,.process of 
*^^*P^*^>'*^? ^^^^^^^^^^ ^^'.^^^^^^y*^ ? ?re-determinod goal, with the 

rjcst important task frequent ly being the establisteaent of neaningful and 
approprlat*! goals. During this par.t year, project management activities 
have been two-dimensional. One has focused upon providing support to 

•2-* _ ^ 
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project staff such that goals could be achieved. The other has focused 
upon establishing a viable concept of Career Education for the Great 
Falls schools. A concurrent concern has been the design of those 
stracegitrs which would be needed to operntionalize a Career Education 
philosophy witliin the tonal school district. Each of these management 
casks has been completed during this past year. 

An especially noteworthy accomplishment has been the identification 
of an extensive array of resourc*;>s for use during subsequent years of 
the project. There can be little doubt as to the adequacy of the 
resource base which has been established for future Career education 
activities. 

Perhaps of equal importance are the variety of baselines which have 
been established to assess future project effects and chc strong staff 
development program initiated. In this latter respect, the project 
df?veloped a mediated presentation which has been used throughout the - 
District, and over 10% of the profesFional s'caf^ have completed an 
intensive course in Career Education. 

C* Conclusions and Recommendations 

Generally, as shown by data presented ir. later sections of this 
report, it can be concluded that the project has achieved the definition 
and development goals established for t\is first year of operation. The 
few areas in which deficiencies were noted were inconsequential to the 
overall intent of the project. 

During succeeding years of the project it is recommended that a 
more precise focus be established in each ot the major development areas 
and that systematic procedures be employed to effect full integration 
of a Career Education philosophy. This recommendation is congruent with 
the general plans of the project — as shown in the model of the conceptual 
structure employed — and consequently should not necessitate any serious 
revisions of future plans. 
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I. DESCRIPTION OF THE PROJECT 



A. IMuloKOpliy and Definition of Career Education Eirpioyed 

The purpose* of this project has been to provide in-service training 
for school district staff and to implement an examplary program in 
Career Education at all grade levels. Additionally, the intent has 
been to integrate the combined efforts of local people, staff from the 
State University system, staff of the State Department of Education, 
and others which would culminate in a demonstration program available 
for observation and/or adaptation by school districts throughout the 
State of Montana. 

' The Broader Context For The Concept of Career Education . The 
problems addressed by this project were succinctly defined in the 
original proposal. These included such diverse areas as the inadequate 
preparation of youth to accept the reality of constructive pathways to 
adulthood, the many facets of the dropout problem, the range of possible 
careers from which a student is expected to make a selection, inadequate 
counseling services, and a failure on the part of public schools to 
fully capitalize upon the many educational resources existent within 
their environment. 

The problem, and therefore the context for the project, is not 
one of developing a specific curriculum but rataer one of developing 
and installing a new philosophy and institutional emphasis for school 
programs. The concept of Career Education is pervasive. It may be 
found in all disciplines, at every level, and related to nearly every 
learning experience to which a student is subjected. 

These various problems have been addressed directly in the planning 
and operations of this project* In many respects, the concept of 
Career Education is an attempt to provide an organizational construct 
for the development of a total education system — an organizational 
focus which will ensure that curricula are perceived as meaningful 
and relevant by learners, not just educators. Kducation has known for 
some time the conditions which should exist in :he schools to facilitate 
i^ffective learning by students. Despite this, our curricula were not 
satisfactory. They needed a more meaningful focus which would facili- 
tate the development of programs to satisfy the long-range needs of 
learners and which would serve to more fully integrate the variety of 
resources available to educational Institutions. It was to facilitate 
this Integration that the concept of Career Education was introduced 
by Dr* Sidney P. Mar)«ad, Jr. , Assistant Secretary for Education, 
U.S. Department of Health, Education and Welfare. In a recent publi- 
cation. Dr. Marland noted that the principles and conCispts underlying 
Career Education are not new. Generally, as explained by Dr. Marliind, 
Career Education seeks tc remove the distinctions between acadcianlc 
and occupational learning programs, which will enable them to serve all 
learners at all levels of instruction in their quest for productive 
cancers and^^^^^r^ llyes.^_^He_trace^^^ history .of _ the idea through 

a series of siRnificant theoreticians, including James Russell, 
John Dewey, Alfred Korth Whitehead, and James Conaiit. 
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One of the Initial activities of the project staff wa.s to. establish, 
in writing, a set of goals which described the desired outcomes from the 
total development effort. Once the project had established a set of 
viable developmental goals, it then became necessary to define & number 
of terms and/or concepts which were employed in the goal statement. This 
definition process was necessaxry to achieve the desired degree of pre- 
cision in terminology such that project staff could ensure uniform com- 
munications both within the staff and between themselves and their 
clientele. This definition of terms also served to set the tenor for 
Che development of viable objectives for the project and to establish 
parameters for the evaluation. 

By carefully and systemmatically identifying included objectives 
within each of the goal areas, the project staff were able to adapt 
their work to the conceptual structure describee earlier. For example, 
the definition level of development was ^^ofined as Phase I of project 
activities. Generally, Phase I would encompass most of the first year's 
activities and included defining such elements as: 

1. Necessary teacher knowledge for purposes of structuring 
in-service training; 

2. Determination of student outcomes to be facilitated by in- 
service training; 

3. Identification of 

(a) Career Education elements presently manifest in the sclioals;, 

(b) Strategies for implementing Career Education at all levels ^ 

(c) Roles for teachers, pr-^^'^ipals and specialists in regard 
to career counseling; 

4. Order and/or arrange clusters in priorities to serve as the 
framework for Career Education instruction at all grade levels^ 

5. Inventory of community resource's; 

6. The need and purpose for advisory group planning sessions; and 

7. Those dimensionis of project activities to be addressed by an 
independent evaluation. r 

Phase II of trie project development effort, the design phase, in- 
cluded rtuch activities as: 

Continued in-service training; 

"Special** in-service to identify roles for improving career 
guidanci? and counseling; 

In-service training related to the design of instructional 

P^^og■^a«l^^•■"and~p«■ekagcs^ ' -~ 
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A. In-service training to improve career aptitude testing 
procedures; 

5. Use of evaluation data to conduct a review of, and revise 
as necessary, program operations. 

Phase HI related to the development and installation of specific 
kinds of Career Education programs. This will include continued 
training for staff, adding cluster programs at various grade levels, 
improving the output of testing programs relative to Career Education, 
and continued development of instructional plans and packages for 
rperationalizing the concept of Career Education. 

Project Objectives . As a result of these rigorous development 
procedures, the project staff was able to produce a set of objectives 
which were internally consistent and which represented the desired 
Career Education outcomes for the Great Falls Public Schools. This 
set of objectives served to structure all subsequent project activities 
including the generation of those data which would facilitate deriva- 
tion cC new objectives and revision of project operations. 

Tlie complete listing of goals and oijjectives developed by the 
project staff are presented in the final report. 

B. Needs Addressed By The Project 

Introduction ^ The basic need addressed by this project has been 
the absence, within the Great Falls Public Schools, of an organizational 
construct wh.i.ch would facilitate the devel'bpment* of a meaningful and 
relevant curriculum* Because of this absence, the Great Falls schools 
decided tOo focus upon Career Education and to implement those strategies 
which would facilitate the diffusion of Career Education throughout the . 
entire educational. structure. The expected outcomes from the project, 
as described in the original proposal, were: 

1. An increased student awareness of the broad range of options 
1ft the world of careers;^ 

2. A reduction of school dropouts; 

3. An increase in vocational guidance services; 

4. Students making more realistic career choices; 

5. A more relevant school curriculxsn; 

An increase in educational and job placement; and 

7. Total involvement of both teachers and administration in 
Career Education. 

It was at oncCi apparent that this was a montjmental undertaking by 
the Great Falls Public Schools. It was because of the scope and com- 
plexdfty of desired outcomes that it was necessary to follow the exacting 
ae fih l tron liri~d~^ ^ 
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ri. PROCEDURES FOLLOWED BY THE PROJECT 

The procedures followed during the first year of the project 
centered on the definition phase of the conceptual model. Staff 
development, both project and district, recieived major emphasis. Site 
visits, study of professional literature, and examination of materials 
produced by other projects were initial activities. A graduate in- 
service education course enrolled tea per ceiit of the district certi- 
ficated staff. 

The classification of objectives into the four broad areas of 
(1) curriculum, (2) counseling, (3) placemen:: and work experience*., 
aiid (4) management, facilitated task assignment. Committees were 
. rKanized In each of the first three areas above and represented all 
schools, grade levels, academic disciplines, counselors,, administrators, 
and in some cases, members of the business/labor community in an 
advisory capacity. 

A. Curriculum Development 

Cross-grade level and inter-disciplinary planning were initiated 
through regular meetings of the Secondary and Elementary Curriculum 
Committees and the graduate in-service program. District curriculum 
specialists were included as necesisary and timely. 

B. Counseling 

This component was divided into Elementary, Secondary, and School 
Incentive Committees to assess needs at the elementary level, improve 
service? and career guidance at the secondary level, 'and tc determine 
action necessary to .increase holding power. 

i' ' - 

C. Placement; and Work Experience 

Tliis committee included district and project staff, Montana 
Employment Security personnel, labor representatives, and private 
personnel and placement agencies. ' It5 function was to develop those 
procedures necessary for job placement which would be congruent with 
labor legislation and local practices. Location of sites and dev<»lop- 
ment of out-of-school learning experiences were also considered. 

D. Project Management 

.Integrating project goals and/or activities with'those of the 
district was of primary importance. Activities were not discrete. 
Tliere Is overlap in objectives and frequently tasks are assigned to 
nore than one staff m'embe; . 
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III. EVALUATION 'OF THE PROJECT 

'K 
\ 

A, Introduction • \ 

The most apparent and significantx problem confronted in the design 
and execution of this evaluation- has been the pervasive nature of the 
concept of Career Education and an associated lack of definition for 
desired outcomes at each of several levels. Expected outcomes listed in 
the proposal described a set of conditions toward which nearly all 
education is oriented. This description of an "ideal" posed one of the 
more difficult problems as typically, little agreement exists among 
educators about what criteria should be associated with a set of "ideal" 
conditions or what strategies will enable these conditions to obtain. 

The first year of project operations was oriented primarily to 
definition processes. The int.^nt in following this strategy was to 
effect the desired levels of definition such that a more precise 
design for a Career Education curriculum could be affected during 
following years of the project. As shown in the model, both within the 
school context and the broader community. 

B. The Evaluation Context 

These inherent complexities, and the absence of a prior definition 
for the major constructs largely prescribed the nature of the evaluation. 
Generally, the evaluation was conceptionalized as a long-term effort, 
with the first and second years of project operations being primarily 
information-based evaluation studies. During the third year of project 
operations, when the project will be seeking ' to establish the general- 
izability of a developed model, the. evaluation will be predicated 
largely on conclusion-oriented studies., However, political realities 
require decision- Information of various types, at different levels, 
throughout a project's history. Therefore, some evaluation activities 
employed traditional design and analysis models, e.g., prepost— testing 
procedures on specified dimensions; establishment of baselines for 
purposes of assessing change; etc. Generally, this rationale is 
consistent with the conceptual structure of the project — definition, 
design, development, and installation. 

Definition for evaluation employed . Evaluation, as employed in this 
project, is a continuous process involving the constant examination and 
reappraij;al of activities and policies which facilitate making rational 
decisions between often conflicting alternatives. It includes identi- 
fying, or specifying, an information need and collecting, analyzing, 
dnd reporting information which will alleviate that need. Ultitaately , 
such evaluation information should lead to some action. If It does not, 
then the utility of the evaluation effort must be seriously questioned,. 
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The concept of evaluation as employed in this project, is not a 
product, but rather a means of enhancing and operationalizing defini- 
tions f:r project intents, and simultaneously maximizing the benefits to 
derive :c'rom consumption of available resources. The intent has been to 
provide that kind of infonriation required for planning and managing the 
project and for ultimately describing the strengths and deficiencies of 
the project relative to desired outcomes. 

Construct Definition and Measurement Procedures , A well designed 
evaluation should have a restricted and thoroughly defined audience. 
This requires that information be collected not just for the record or 
to be used at some future date for theory building. Instead, it becomes 
the evaluators' responsibility to work with all levels of decision- 
makers and determine what information will be relevant and valued. 
Attention must also be directed toward "what" is to be evaluated, II 
this latter instance, the process employed will ultimately describe 
decision sitvations to be served, the environment within which the 
evaluation is to occur, and to specify those policies which will govern 
the evaluation. 

The general referent for accomplishing these tasks is typically 
derivation of a definition for the evaluation context- defining those 
elements, or factors, within the enviroiinent which surround and influence 
the project and the total educational nrograni. In ti)is\situation, it is 
necessary to extract from the multit'>dinou.s variaoies extiNant, those 
which are relative and meaningful to the value systems an^. needs of 
specified decision-mijikers , To define the evaluation contexV in this way 
is to- give it meaning; with meaning, in this situation, referx^ing to 
visible and communicable indicators for the variables of concern and 
observable manifestations of those variables, \v 

Tliis definition process is a necessary requirement to effect valid\ 
and useful measurement procedures. Through -this definition process, the 
constructs to be observed are identified. and their properties carefully 
specified. This is a fundamental operation in any measurement process, \ 
In this evaluation the primary constructs observed were: (1) curriculum 
planning and development; (2) placement procedures, with placement being 
broadly defined; (3) Career Education counseling; and (4) project 
management. However, simply identifying, or naming, these , constructs 
do not provide sufficient information about them to support useful, 
measurement procedures. It is not sufficient to simply state that a 
given program has been designed to insure students* abilities to make 
wise career choices or to coordinate curriculum development efforts. 
Necessary definition? must go considerably beyond this and specify what 
dimensions of project operations are to ultimately be manifest in observ- 
able effects upon students, manifestation of career education goals, and 
how these are to be quantified. 

C. Purpose for the Evaluation 

The second factor considered in this evaluation was that the project 
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Requirement ts also exist for a different type of information than that 
needed by the project staff. These .-xeqoirements are those which are 
oriented toward generalization, or diffusion, of terminal products. In 
effect, these information requirements are conclusion-oriented, whereas 
project requirements are decision-oriented. 

Because of these differing information needs, it was decided to be 
in the best interests of both the project staff and t:he project sponsor 
to consider the information needs of each from initiation of the project. 

Fig. 1 
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Evaluation Model Employed , While several alternative evaluation 
models could have been employed to structure this evaluation, the model 
developed by Stake appeared to be most congruent .with the intents and 
information needs of both the project and the project sponsor. 



Fig. 2 . 
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The model graphically illustrates that formative and continued 
development of a project is typically directed by three sets of intents: 
(1) a set of characteristics describing project preconditions 
(antecendents) ; (2 ; iihe set of development actions that are intended 
(transactions); and (3) the set of expected outcomes, or products, of 
the project. The logic inherent in the model is that evaluation of a 
project is two-dimensional. The first is an examination of the con- 
tingencies within and between each of the three sets of intents. The 
second is an examination of the congruence between a set of intents and 
of corresponding observations. 

Application of the Model . Perhaps the major strength of the model 
in this evaluation was that, while it provided a structure for concept- 
ualizing the design, it did not impose constraints upon types of data 
to be employed or decision processes which could t)e served. Consequently, 
it was employed in developing all pertinent dimensions of this evaluation. 

The model is especially useful for satisfying accountability require- 
iTicnts, in that it facilitates a comparison of project plans aud actual 
events — which relates directly to the most widely used definition of 
accountability. It also facilitated identification of wha\: products 
and/or activities the project was to be accountable for, i.^., the 
piToject should expect to be accountable only for those activities and/or 
products which actually consumed project resources. 

Objectives for the Evaluation , In a developmental program, such as 
the Great Falls Exemplary Project in Careeu: Education, the primary 
purpose for an evaluation was to supply timely,' credible, and manageable 
information that would support project staff in meeting four basic 
. respon}>ibilities. These are: , \" 

1. Establishment of meaningful and valid criteria for project 
outcomes; 

2. Effective and prudent use of project resources to attain 
project goals; 

3. Objective and useful dissemination of information to the 
educational community and other concerned publics; 

4jj^ Accountability to the sponsoring agency. 

Generally, satisfaction of these responsibilities required first, a full 
and accurate description of project staff operations; and second, com- 
parison of present and future manifestations of the project goals in 
student behavior. The conceptual structure for the general design of 
the total evaluation effort is shovm in zhe conceptual design on the 
following page. 
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Fig, 3 

Conceptual Design for the Total Evaluation 
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This structure generally follows the conceptual model for the project 
presented earlier. In effect, the various phases of the evaluation were 
applied to first year project activities. These same phases may be 
applied to the major emphases of the project during the remaining two 
years of proposed, funding . For example, one of the major emphases of 
the project during this past year has been to effect a more precise 
level of definition for the primary constructs of concern, e.g., career 
education, integration of community resources, development of career 
education curricula ^ etc. Typical activities conducted during this past 
year in the predesign phase included the design and conduct of inter- 
views with project staff, teachers, administrators, local employers, and 
related egencies for purposes of establishing criteria for project 
objectives, and determining information needs of members from these various 
groups. A second activity in the predesign phase has been to identify 
administrative constraints to conduct of the evaluation. 

Typical activities during ^he design phase, during this past year, 
have included such things as (1) derive and verify indicators, measures, 
sampling, reporting procedures, etc. for each ox the major project goals; 
(2) identify specific studies which need to be conducted in succeeding 
years of the project; (3) design an information feed-back system for use 
by project staff ; and (4) identify those record data which would serve a 
project accountability purpose. 

Activities included within the implementation procedure were: 
(I) management of the total evaluation effort; and (2) revision of the 
evaluation as new information dictated. The reader is cautioned not to 
interpret this last implementation activity as reflecting an undefined 
procedure. Instead, this type of activity is necessary when the evalua- 
tion is designed to satisfy the decision processes employed by the pro- 
ject. A parallel activity included the conduct of those studies which 
would provide necessary data for effecting generalization of the model to 
other school settings. ^ 
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Objectives for this evaluation were designed to provide those data 
which would assist the project staff in their efforts to satisfy the 
basic responsibilities listed earlier. Specific objectives for the 
evaluation were to: 

1. Provide those descriptive data which would assist the 
project staff in establishing desired outcomes and 
criteria for their attainment; 

2. Provide information specified by project staff which would 
enhance their capability to effectively and efficiently 
allocate project resources; 

3. Provide information which would enable the project staff 

to prioritize project outcomes and activities of the project; 

A. Describe each project component in a manner which would 

enable other agencies to adopt or adarc specific components; 

5. Provide Information to project staff and associated persons 
which would support their decision-making capability relative 
to revision, extension, or termination, of selected project 
components; 

6. Provide those data which woul facilitate determination 

of which activities and/or products would generalize to other 
settings, and which may, therefore, function as components of a 
transportable model; 

7. Determine, within the ability to define and :*iuasure them, 
program efff.cts upon the career patterns of students; 

8; De.s; * and conduct evaluation studies which would 

measure the degree to which annual project objectives 
were achieved. 

Audiences for the evaluation . During this first year of the project, 
Che intent has been to generate a variety of data which would facilitate 
de-finition of key constructs by project staff. This emphasis suggests 
the primary audience for the evaluation has been the project staff. 
However, because of the project intent to develop a generalizable model, 
other school districts and the project sponsor will also be interested 
in knowing about the achievements of the project and problems encountered. 

The potential effects of the project are wide-reaching, and conse- 
quently, could have a significant impact upon many dimensions of the 
coTJnunity. Consequently, this report may also be of value to directors 
of otier programs which are designed to integrate the concept of Career 
HducaUion into ongoing school curricula. 
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DecxBions be Served by the Evaluation , Generally,, evaluative 
data is most uscrul in facilitating decisions related to revision of 
existing components\, extension of existing components, termination of 
existing components^ or development of needed components. In the case, 
of the first decision category, information related to the effectiveness 
and perceived benefits from a given course of action may be used to 
restructure that program to make It maximally beneficial to participants 
The second decision category relates primarily to extending or enhancing 
some component which is already part of the total system. In effect, 
these data show where additional efforts are necessary and the general 
nature of those efforts. . The third decision category relates to identi- 
fication of those program components which had little or no effect upon 
participants, and consequently, attainment of project -objectives. This 
beinv> the case, those components should be removed from the program as 
they tend C>nly to decrease the efficiency of the program. The final 
decision category relates to identified needs which remain unsatisfied 
by any. of the project components. \^en this condition obtains, then 
additional voject effort should be expended in an attempt to satisfy 
those needs, 

D. Data Generation Procedures 

Introduction . During the initial design stances of this evalua- 
tion, it became apparent thai: a single procedur-:: Cor collecting the 
necessary data would not suffice. Because of the developmental 
nature of the project, an attempt was made to bring several divergent 
points of vi^iw to bear upon significant aspects of the project such 
as the definition of Career Education, integration of community 
resources with school 'programs, etc. 

This attempt to clarify many of the possible alternative courses 
of action for the project ultimately led to employing four different 
types of data generation strategies. These included interviews, 
questionnaires, a previously completed "needs" assessment study, and 
project record data — those data routinely emergent from project 
operations. , 

Data Collection Procedures . Fifteen questionnaires, two attitude 
scales,, t\nd four standardized tests were employed to collect data 
for the conduct of this evaluation. These instruments were completed 
by project staff, teachers, administrators, counselors, local employers, 
rep\resentative labor and management groups, parents within the community, 
r-cognized autliorities in Career Education, and various samples of 
- tufdents from throughout the district. 

Copies of a] L instruments which were employed in this evaluation 
are includod as Appendix A to this report. 

<• 

S/\npIing Procedure and Instrument riistribution^ : Because of the 
.• v^-.-s^ orientation for this evaluation, and the nature of information 
-si'ri'Li, establishment of critical confidence limits for the ,data was 
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not deemed essential. Consequently, although samples employed were 
very carefully selected, they were relatively small. In several 
cases where the total number of respondents available was quite 
limited, one hundred percent of that population was asked to complete 
various instruments. Specific examples of this latter sampling- 
strategy included counselors, work coordinators, principals, and 
members of the advisory board. 

In the case of teachers, laLor representatives, and employers, 
random samples oT inCividual respondents were selected. Students 
were sampled by intact groups which had been randomly identified 
from among all available groups within the school district. The 
parent sample was not randomly selected due to the inherent distri- 
bution problems which would be encountered from this sampling strategy. 

E. Report of Evaluation Data Related to Goal Attainment 

In^o riuction , The process orientation of this evaluation, as 
discussed v.n the rationale section of this report, was adopted'.to 
satisfy both the short and long range planning needs of the project and 
to serve identi fied , information needs of the project during the defin- 
ition and development stages. A concomitant concern has been to satisfy 
received information, needs of • the'.project 's . sponsor and to establish 
baselines for succeeding years of project operations. /. 

The need to satisfy diverse . information requirements necessitated 
the establishment of several reporting categories which were not related 
SGx.ely to project goals. For example, laany of the project activities 
were developmental in nature and. as a consequence ^ single activity would 
relate to more -than one of the project goals. .However, to satisfy 
project accountability, it was felt necessary to report these kinds of 
. activities , 

Because of these varying information requirements, this section of 
.the report has been organized into seven components. The first four 
describe the various activities and accomplishments of the project' in 
relation to each of the four major project goals. The next section 
describes those baselines which have been established for future use by 

Project. The lasr. two components of this section include those 
data which describe project development activities and those data which 
should set aside project accountability requirements. Accountability, 
in this case, has been defined as project awareness^ by those- clientele 
served by the project, the degree to which installation of a Career 
Education curriculum has obtained, model generalizability or transpor- 
tability, etc. Development activities reported include such things as 
in-service training, role definition activities , material resource 
Identification and acquisition, and identification of trends in Career 
Education which may be used to establish lonft range goals for the 
'.project:. 

: ..3.12 : ■ ' 
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Goal 1; Curriculum Development: , Curriculuir. development concerns 
pf th^ project have focused prinarily upon development of content out- 
lines for a Career Education program and strategies to effect integration 
of that progra*^ into the ongoing curriculum. For reporting purposes, 
these concerns have been organized into four general categories of 
project activities. These are: (1) Development of a scope and sequence; 
(2) Content outlin€s; (3) Instructional strategies; and (A) Inventory. of 
available resources. 

Coal 2: Counseling: . Counseling role^s, in a Career Education effort, 
have been described as one of the more critical elements to be refined 
if the concept of Care^ to become fully developed. Gene r-_ 

ally, the counseling goal for this project has been oriented toward 
development of the student's self-awareness andJrfs capability to use a 
variety of data-in making career decision^-^--^l*roject activities designed 
to assure attainment of this goal have ^focused upon familiarizing 
counselori? with the concept of Career Education, exploring; alternative 
testing procedures, and the development J of information centers which 
would provide students with a common source for a variety of career 
information. For reporting data purposes, data related to attainment 
of this goal have been divlied fnto four sections. These are: 
(1) student -perceptions of couiaseling needs; (2) a description of 
career counseling activities within the district; (3) actiwiriies related 
to the development of career information center*:; and (4) testing programs 
employed by the Great Falls Public Schools, '^lese data are reported in 
succeeding components of this section of the report. 

Goal 3; Placement . In many respects, this goal has. been misnamed 
and as a consequence, connotes a rather restrictive focus for operation. 
However, the goal statement ftself and project activities related to this 
goal both describe the comprehensive and ver>' critical component of the 
total Career Education effort. In all likelihood, it is through the 
placement activities of the project that effective integration of the 
range of desired community resources with <ichool programs will ultimately 
occur* 

Generally, project activities during thin past year in relation 
to placement Cuave focust^d upon four classes of activity. These have 
been: (I) iditinti f ication of 'community resources; (2) work experience; 
(3) continuing education; and (4) establish:!ient of an employment and/or . 
placement service for students. Each of tliese different foci of 
project activity will be discu-^^^^^ed in the succeeding section of this 
ro;u)rt. \: ] 

Gon! Project Managei^ont . It; has been difficult, in determining 

10 reporc this evaluatioh, Lo dif rer*'ntiate between the concepts of 
nar' axemen t , development , anty account^ib il i ty. Bi^cause all three of these 
.1? :>frva'^ivo eleru^nts wltliin Lite project context, the differentiation has 
buc:. uiite <irbitrarj'. Bd^^lrally, J e t:t> nr i nation of which <lata and which 
is-'i'.-;. to report in each/ ^.>f/ thv-iu' catt*p.<ir i es has been l^ised primarily on 
ea t ..>f r-^r.^rtin^; and In an atto:r,pt to facilitatu tlie read^ibi 1 1 C v of this 
r.;. t:-.. / 

i 
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Management, in a general sense, is defined as the allocation of 
resources to achieve predetermined goals. For this project, management 
is of special concern because of the very nature of the project. First, 
the concept of Career Education recjuires adoption of a totally new 
curriculum philosophy by the school district. The second requirement 
for the project is to develop a model which will generalize to other 
school settings. One or the other of these two requirements would be 
difficult. In combination, they become almost impossible. It is only 
through effective management that both outcomes can possibly be obtained, 

_ t'nJ^^J? 9X ^^^^ could well have 

been included within the management function include: (1) management; 
(2) development; and (3) project accountability. However, there appeared 
to be certain unique qualities of the project which could best be reported 
under management, those which chould best be reported as development 
activities, and finally those which could best be reported as accounta- 
bility to the project sponsor. Therefore, incl'^ded ic this section of 
the report, devoted to management, are only '.aose activities which have 
been oriented toward integration of the Career Education concept into 
the schools, development of a Career Education model, and provision of ' 
necessary resources for the project to function. 



Baselines for Future Project Oper^.tions . In a previous section of 
this report^ the* pur[)ose and nature of basr^lines for project operations 
were discussed. As noted there, four types of data have been employed 
to establish baselines. These are: (1) standardized tests; (2) locally 
developed tests; (3) special studies; and (4) record data. 

In some respects, it is unfortunate that reporting requirements for 
the project employ the necessity for establishing baselines at this early 
date in the project's history, tThis condition is unfortunate because of 
the ambiguous nature of desired student outcomes. However, since the 
project must exist within the real world, an attempt has been made to 
establish those baselines wH Icll appear to have the greatest potential 
for future use by the project and which vould be most meaningful to 
project Hponsors. 



As explained earlier, many of the baselines established for this 
year of project operations were established on a conditional basis. 
This was necessitated by the precarious nature of baselines at this early 
sta?;e in the project's history. In many respects, reporting baseline 
data in this report will have little value to either the project or the 
projecr: sponsor. Thr: main purposes for including baseline data in this 
report are to describe project efforts in this activity and to record 
those data which nif;ht bemused for assessing effects of project opera- 
tions durin^: succecf' in;', years. 
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Developmental Activities , Several elements of information reported 
in this evaluation have indicated that effective integration of Career 
Education would probably not occur until such time <- school staff had 
accepted the 'philosophy of the concept and were familiar with Career 
Education strategy which they could readily incorporate into their ongoing 
programs. Consequently, because of the importance of staff development 
activities, the majority of this section of the evaluation has been 
devoted to the staff development activities conducted by the project. 
Included are in-^service training activities, role definition, trends in 
Career Education, developing an inventory of community resources, and 
finally, material resources identification and acquisition. 



In-Service Training . Importance of an effective in-service traihing 
program has been emphasized in several sections of this report. Perhaps 
^he most significant information, relating to this aspect of the Career 
Education project, was that provided by the Career Education specialists. 
In virtually every question to which they formulated a response, they 
tended to emphasize the importance of developing staff attitudes and 
knowledge about the concept of Career^ Education. 

The primary project activity related to in-service training was the 
conduct of the formal course. It is of interest to note that barely 10% 
of the instructional staff of the entire school district were enrolled 
in this particular course. These students wpre granted five credit hours 
through a local university for completion of the course. Published 
instructional objectives for the in-service program conducted by the 
project were to insure that each student will: 

1. become aware, of the concept of Career Education; 

2. Demonstrate his or her understanding of Career Education; 

3. become acquainted with Career Edtication programs in Montana; 

4. develop a philosophy of Career Education and relate this 
philosophy to the class; and 

5. be able to list and explain the component parts of a Career 
Education program, i.e., awareness, exploration, application and 
specialization. 

Instructional strategies employed in the course generally focused 
upon the use of a variety of consultants, extensive reading, and the 
completion of one or more group projects. The course outline for this 
in-service training program is shown in Table 1. 
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Table 1 

Course Outline for the In-Service Program 

I. What is career education? * 
* a. Definitions 

b. Role in total education programs 

c. Purposes and objectives 

d. Career education models 

II. Career education at the elementary level, (awareness) 

a. Purposes and objectives 

b . Clus teFidehtif ica^^ exposure " " 

c. Programs and activities 

d. Role of education personnel 
• e. Role of community 

f. Relationship to other components 

III. Career education at the jxjnior high school, (orientation) 

a. Purposes and objectives 

b. Cluster identification and orientation 

c. Programs and activities 
Role of education personnel 

e. Role of community ' " , • 

f. ' Relationship to other components 

IV. Career education atythe senior high school, (application) 

a. Purposes and objectives 

b. Cluster experiences 

c. College bound/non-college bound considerations 

d. Programs and activities 

e. Role of education personnel 

f. Role of community 

g. Relationship to other components 

V. Career educatl^on at the pont-secondary level, (specialization) 

a. Purposes and objectives 

b. Occupation/profession specialization 

c. Programs and activitlfis- 

Vo-tech, community college and university considerations 
e« Role /of education personnel 
fi Role of commmity 

g. Relationship to other component parts 

VI. Trends and Implications 

a. Directions in career education 

1>. Opportunities in career education 

c« Implications for new and experienced educators 

VII. Summary and conclusions 

a. Need for a system approach in career education 

b. Need for improved articulation 

c. Need for improved communication 

-19- 
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Role Definition , Because of the ambiguity which typically surrounds 
the concept of Career Education, it was felt this evaluation could provide 
valuable insights for project staff regarding perceived roles by several 
different populations. Consequently, teachers, cotmselors, administra- 
tors, the Advisory Board, and parents were 'all asked to define what 
they perceived as their role in a Career Education curriculum and how 
this may be different from their role in a non-Career Education program. 

Teacher perceptions of the differences between Career Education 
and what they had traditionally done are summarized in Figure 13. As 
shown there, teachers apparently believed that a Career Education pro- 

' gram^ wiir require more direct work experience and that students 'will 

develop a greater awareness of career opportunities with' this new 
organizational focus. Summarized in Figure 14 are teaeher perceptions 
of their roles In the process .of integrating Career Education. As 
shown there, they perceived their role to be one* of curriculum develop- 
ment, the development of instructional strategies, and the development 
of strategies necessary to integrate the concept into the curriculum. 

Counselors were asked directly what they perceived as their role 
in relation ^.to dropout problems, support, of teachers, curriculum design, 
student work and/or study placement, and the dissemination of Career 
Education information. There was virtual consensus among all of the 
counselors that they had an important role to play in each of these areas 
with one exception — student work and/or placement. Counselors lack of 
concern for and commitment to, student placement and work experiences, 
was apparent in other dimensions of this evaluation. It strongly 
suggests the project will need to establish a student placement service 
if thi^ aspect of Career Education is to become fully developed. 

Counselors were also asked if they were aware of a defined role 
for them in the project. Approximately 64% of them indicated they were 
aware of a role and among those who indicated they were not aware of a 
role, all of them specified they would prefer to havv^ a defined function 
within the project. 

Approximately one-half of the counselors who participated in this 
evaluation indicated they had- responsibilities in the area of work 
experience. Job placement, and. academic placement. Less than one-third 
of the respondents indicated they had some responsibilities in the area 
of the cooperative v/ork program* In some respects, this information is 
contradictory to that which has been presented in other sections of 
the report. 

It does indicate a need on the part of project^ staff to clarify 
the counselors' role as Career Education programs become more articulate 
and more fully integrated into the curriculum. Information which may be 
useful in this respect was presented earlier as baseline information— 
this was the distribution of counselors' time. 
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Administrators were asked what they perceived as their role in the 
development and implementation of Career Education in each of six differ 
ent areas. Their response to this question are presented below: 

1. increased student awareness of career options 
. -help teachers plan programs 

-help teachers locate materials anci other necessary resources 
-provide administrative support for field trips and other 
types of ^Career Education activities 

2. reduction in school dropouts 
- " -provide -information. -and. counseli^ 

and students 

-develop instructional programs which are more individualized 
in nature 

3. increased 'vocational ' guidance services 

—serve as a resource person 
-this is not my Tola 

-make students more fully aware of services provided 

4* student opportunity to make career choices 

-this is not our responsibility (elementary level) 
-provide opportxinities for students to explore a variety 
of careers . ^ 

5. increased relevance in the curriculum 

-promote an atmosphere which fosters experimentation 

through such activities as faculty in-service training 
-curriculum revision and/or construction 
-through teacher awareness 

6. involvement of school staff in Career Education 

-heighten teacher motivation to integrate the concept 
-dissemination of information about Career Education 
-provide guidance and in-service suggestions 
-coordination of all activities related to development of 
the concept 

Advisory Board members were asked what they perceived as their 
role in relation to- three specific classes of activity. The large 
majority of respondents felt their primary role was two-fold: to pro-r 
vide information and to serve as a consultant to the project. They 
specifically indicated their role did not include making decisions. 
Over 60% of the Board members indicated they were satisfied with their 
present role. Some concern was expressed about the usefulness of -the 
Advisory Board by several of its* members, which is not an uncommon 
situation. Typically, such concerns are expressed by those Board members 
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who have decisiott-making responsibiiities in their vocation and conse- 
quently are uncomfortable in an advisory capacity. If these attitudes 
are allowed to continue or develop, the usefulness of the entire 
Board can.be jeopardized. 

Parents who participated in this evaluation were asked to describe 
their perceptions of the desired role for both themselves and the 
community in a fully operational Career Education program. 

It is interesting to again note .the lack of importance attached 
to providing students with work experience within the community. This 

aspect, as one function of the project place ment program, should be 

subjected to more careful study, - : 

^ Parent perceptions of their role are congruent with what could be 
expected in a functional Career Education program. However, it does 
appear that they will need to be kept fully informed about project 
developments and also be supplied with that information which will 
enable them to satisfy responsibilities to their own children. Possibly 
this could become one dimension of the Public Information program 
planned by the project. 

Accountab ility to the Project Sponsor . Four general issues were • 
perceived as being of special significance to the project sponsor and 
consequently have been addressed in a separate section of this evalua- 
tion. These are: (1) project awareness by its' constituency; 
(2) effects within the District; (3) project operations; and (4) model 
generalizability. Data related to each of these issues are reported 
in succeeding sections of this report. 

Project Awareness . Several sources and types of data were employed 
to determine the degree of constituency awareness of the project. First, 
district administrators were asked what they perceived as the major 
purposes for the project (all were aware of the project because of 
district administrative procedures). Their responses included the 
following kinds of comments: 

""^ ~ ;'^ake- students aware of'^'cateet'S^^ ""^ ' ' ^ '"^ ...... .h., 

-provide opportunity for student to explore careers 

-provide students with wider knowledge about the world of work 

-provide resources in support of a career exploration program 

-develop student self-understanding 

-assist students in making career decisions 

-create an interest in people and their occupations 
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One of the most poignant comments- made in the total evaluation 
efforts was made by one administrator in response to this questionnaire 
item. His comment: ■ 

-not to teach different things, but to teach things differently 

This individual has captured much of the purpose for Career Edu- 
cation in one sentence. 

Generally, administrator' perceptions of project purposes are con- 
gruent with the goals of the project which suggests they were very much 

— aware of thg^.p,roj,ect IIieJLr_.coiimienXs„ar e-^perhaps.- b es4^ummarl ze d- as ~ 

(1) development of student self-awareness; (2) development of student 
career awareness; (3) provide Career Education resources; and (4) inte- 
grate the concept of Career Education. 

School district counselors and Great Falls labor representatives, 
^ as one dimension of a separate question series, were asked if they were 
aware of trhe project. All of the counselors indicated they were aware 
of the project and responses to additional questions indicated they 
understo(5d the purposes for the project. 

However, only 50% of the labor representatives questioned said 
they were aware of the project. Those who are aware of '.the project 
also appiarently understand the purposes of the project. For example, 
they described purposes, such as familiarizing students with a career, 
support a work placement program, etc. 

The staff site-visit program has apparently contributed heavily to 
development of project awareness throughout the district. Information 
about this project activity is included as Appendix J to this report. 

Another project activity which has undoubtedly contributed to 
development of project awareness, was publication of various brochures 
and a project newsletter. Both of these documents received wide dis- 
tribution throughout the district. 

» 

. J^^^^^y^ project staff carried on an intensive program specifically 
oriented to deveiopm^^^^ ' 
Education. A mediated presentation was produced especially for this 
effort and programs were presented in the majority of schools within the 
district. j 

Effects Within the District , Two classes of project "effects" were 
assessed for purposes of this evaluation. They were labeled "general" 
effects and those which were associated with installation of a Career 
Education model. 

It was assumed that administrators, because of their role within 
the schools, could best judge the degree to which desired project out- 
cones were being attained. Their rating of project progress are 
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summarized 30, As shown, the project was rated generally low 

in. four are^^' reduction in dropouts; (2) vocational guidance; 

(3) student ^ar^^^ choices; and (4) educational and job placement. 
Sinc<^ -tliese fou^^^'*Utcomes could only- be-attained by a- fully-operational — 
program, the la^*^ Of progress at this time is not: considered significant. 
As noted eafJ-^e^^^tl this report, these four areas are receiving con- 
centrated at^^nt^-^^n from project staff. 

One dim^Tisi^^ of general effects which was considered important 
for this eva^-^a^ was that of project management. Again, school 
district aduji^i^^^^tors were asked to rate the project this time on 
the ef fecti yg^eg^^tid efficien cy of project management. Their ratings 
are suramari^^^ T^le 32. These ratings, which were made by persons 
who are famiJ-ia^' ^i^h management principles, generally suggest the 
project has beei^ ^^11 managed. If the contingency relationship 
between maixia^^^^^} project effects holdj true, then it can be 
concluded th^ P^^^^cit probably had as much impact ais possible during 
the first ye^'^ ^pct'ations. -? 

J ' ... - 

Flnallvf ^ Uie^ns to identify district administrators perceptions 
of the proje^^^> consequently the degree of support which chould be 

expected frcti^ tli^^% they were .asked to rate the project on selected 
dimensions st^^h Usefulness, importance, etc. Their ratings are 
summarized iti T^^^^ 33. As shown, this group rated the project generally 
high, which ^^gg^^^s they have accepted the concept and will probably 
be supportive ^tu^e project efforts. 

Instal j^^^^^^^f ^Career Education/ Concepts . This aspect of project 
effects was ^ss^^^^^by student descriptions of^ observable Career 
Education acC^^i^^^^ currently present in the curriculum and adminis- 
trators' rati^S^ project effects. . 

- Over 45^ oi^^^ student sample reported they had experienced what 
they would ccjnsi^J^^' "Career Education" in their courses this, past year^ 
Courses named ^Ving provided a "career education experience" included 
the following* 

• . > 

Knglif^h 

Scief^Ce 

Math 
Algebra 

Art ' 
Home Ec^^^tUics 
Phygi^ai- Education 

This li^Cing courses is interesting as it includes several which, 
iii a traditicf^^l ^.^^gram, would not be considered career oriented. The 
listing sugge^^^ ^^t students are becoming more aware of career options 
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and the train:^ng requirement's for careers. It also suggests that 
^ teachers haveJfeiade-^a„mQre concerted effort to emphasize the congruence 

^^.^ 5?^^^.. course content and Jpq ten career fields .^._All....Qf„.these 

factors should, ultimately contribute to ensuring* curricular relevance. 

Project Operations . ^Several elements of record data have been 
employed to describe . significant project operations. Of these data, 
perhaps the "Dropout Study," included in Appendix L, is the most signi- 
ficant. This study was conducted very systematically and explores 
in-depth- the causes for students leaving school prior to graduation.' 
^ This information should be' especially useful to both the project and ' 
the dis tr ic t , generally , in futTire~activities--ln- that"it" establishes 
a useful data base for program design. 

A second element of record data which was perceived as significant 
was the number of Great Falls , employers with whom the project had 
effected some form of interaction. The number exceeds 300. A record 
of these interactions has been established which includes all pertinent 
information for the project to ^Integrate these employers into the 
placement 'program. ' 

F. Conclusions and Recommendations^ 
Conclusions 

General . The project has experienced a number of difficult situa- 
tions during this first year of operations. Perhaps the most signifi- 
, cant of these was resignation of the individual who wrote the original 
.proposal. This factor, coupled with the nature of the propbsal, 
necessitated the development of an entirely hew set of operational pro- 
cedures. For many projects, such an initial hurdle would have been 
fatal. However, the rare degree of commitment and creative ability 
manifest within the project staff enabled them to successfully achieve 
the desired level of outcome in each goal axea. *' 

The unity of purpose among project staff and dach person's high 
level of achievement motivation were not specifically addressed by this 

the most significant in ensuring the project's successful completion 
of this first year. 

Devr ioping .a fuller understanding of the broad concept of Career 
education among district staff appears to have been the mo5t important 
outcome achieved in the initial year. Conversely, community involvement 
aas been the area in which the least success was observed. This lack 
of community involvement should not be considered a serious shortcoming 
a.s this first year was. devoted largely to defining Career .Education for 
z:w Groat Falls schools. It may prove to have been politJcally wise to 
"^^^^ involve the community to a great degree until such time as a more 
definitive program and a more definitive role for the community has 
been established. Tliis factor can, and should, be assessed in succeeding 
years of the project. 
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Goal 1: Curriculum Development > . Data presented earlier in this 
report generally have shown that definition of a curricuiar scope 
and sequence, for integration of Career Education, has progressed very 
well. By the end of this next year, given the same amount of develop- 
ment effort, curricuiar revision processes should be nearly completed. 

The most sigaificant project outcome, in relation to this goal/has 
been the extensive resource base developed for Career Education. Histor- 
.ically, the lack.- of necessary resources has been the most serious con- 
straint to. the installation of an innovation. This potential problem 
area has been largely eliminated by the project. 

Goal 2; Counselii . . Generally, data presented have shown that 
counselors manifest aful attitude toward Career Education and are 
desirous of doing mox.o career counseling. Significant progress was' 
made toward establishment of Career Information Centers, which should 
greatly enhance counselors' abilities to develop students' career 
decision-making capabilities. It is noteworthy that project staff have 
been especially influeritial in the establishment of these centers. 

Several standardized tests were administered on an experimental 
basis this past year. Analysis of data from these testing procedures 
should facilitate the establishment of an elementary career counseling 
program which, in turn, should have significant impact upon instructional 
strategies employed by teachers. The \ synergism which exists in^-.this area 
should be carefully observed throughout the second year of operations, 

1 ' 

Goal 3: Placement , The potential of the placement program planned, 
and currently becoming operational, is' very exciting. 'Of special signi- 
ficance is the planned coordination of; effort among a diverse range of 
agencies. However, at this time, there is some confusion among repre- 
^•sentatives from these various agencies as to their role within the total 
effort, this being especially noticeable in comments made by Labor repre- 
sentatives. Defined roles for each agency participating in the placement 
program should be estab lished soon . 

There also appears to be. a need to expand the work experience 
P.^cj^? . .9? the . prqg,r£un, . bp th conceptually, and...pperationally, beginning 
with the establishment of specific objectives for each element of the 
total program. This e:ipansion effort should be completed early during 
the second year of operations. In this same regard, there is a need to 
-estnbll.sh procedures for effecting integration of the work experience 
concept throughout the curriculum. For example, the work experience 
program is limited, at this time, to Office Education, Distributive 
Education and Industrial Cooperative Training. 

Goal 4: Project Management . All of the data presented in this 
report are supportive of the, project management effort. Considering 
Che nature and signif icance of problems confronted by the project, this 
is; probably the area in whictK the greatest achievements were obtained, 
nils factor is especially significant in a project as complex as this 
one, for it establishes an operational base for use in succeeding years. 
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One dimension of 'the total management effort was noticeably weak, 
the use of Career Education specialists to. facilitate generalizability 
of the total model. Those 'specialists who, were identified for partici- 
pation in this evaluation made a very weak contribution. 

Recommendations • 

. ' — — ; 

Based upon the data presented earlier, the following recommenda- 
tions seem appropriate: . ' 

1. A strategy should be designed for employing the Advisory 
Board as a means to effect wider community involvement; 

2. A closer liaison should be established with labor groups 
as there appears to be a number of potential problems in 
this area; 

3. Continuation ^nd expansion of the in-service training 
program is clearly needed; 

4. A strong, systematic, information dissemination program 
would probably be of benefit to the project; 

5.. Specific model development foci should be established for 
this next year to avoid inefficient expenditure of staff 
resources; * 

■V 

6. Model development, during this next year, should focus | 
upon specification of model characteristics and testing ^ 
of those characteristics. This will probably- require the' 
design and conduct of comparative studies; 

7. Emphasis in the next evaluation should begin to change from 
a process to.a product orientation. 



IV, PROJECT OUTCOMES 



A, Concept Definition *\ 

Evaluation data indicates that participants in the graduate in- 
service class have a more comprehensive view of career education and a 
deeper understanding of project goals than do others responding to the 
questionnaires. There is an increasing interest among teafchers, as they 
become aware that development of career education activities is con- 
sistent with their objectives and instructional strategies. This implies 

emerging -.def initions-based- on--experience - and^a- need- t;o-^^ roaden- the 

experiential base for as many publics as possible. 

B. Program Development 

Elementary Curriculum . Teachers have developed instructional units 
designed to increase self-awareness and career awaraness. These units 
are not adjuncts to the present curriculum but integrate career educa- 
tion concepts with basic content areas. .Complete curriculum review and 
revision was begun at kindergarten level and will form the basis for - 
continuous action throughout the elementary grades. 

Secondary Curriculum . Teachers have de-^'eloped instructional unitii * 
related to their respective disciplines. Junior high schools haVe 
initiated mini — or avo — courses, 'as well as brief occupational aware- 
ness units.. Career education is a major focus in a Consimier Economics 
course currently in the developmental stage. The Distributive Education 
program was expanded, becoming the first step in* a cluster curriculum. 
Recommendations were . presented to the district for^^a sitnilar change 
in Office Education. Initiation of the Industrial Arts Curriculum Pro- 
ject (McKnight Publishing Company) at ninth grade should lead to a 
cluster in Construction. Over 800 secondary students will participate 
in the U.S.O.E. sponsored SateJ^lite Technology Demonstration. 

The committee developed a checklist for teachers to assess career 

education classroom activities and materials during the 1974-75 school 

year. X^J s group al level 

of inclusion of career education concepts in the secondary curriculunw 

Counseling . ^ Intensive planning for facilities and screening of 
materials were emphasized during the first year in order to expand 
career guidance services' in the secondary schools. This was a coopera- 
tive effort and includes counselors, librarians and instructional staff. 
Two objectives will be easy access to materials and increased counselor 
qontact. 



Project staff, counselors, Ej^plorer personnel (B.S.A.), and 
computer experts developed a Career Interest Survey which provides 
printouts to facilitate group career counseling and to plan curricu- 
•'lum based on student needs and interests. The survey, form and computer 
program were shared with major school districts statewide. 

Placement and Work Experience . Efforts during the first year 
were directed toward bringing together those people and agencies whose 
chief function is job placement and developing communication channels 
and operational policies -such that both full and part-time employment 
facilities could be installed in the secondary schools. Recommenda- 

of Trustees, and, if approved, will be implemented during 1974-75. 



V, RECOMMENDATIONS FOR FUTURE ACTION 



Based on first year results, the in-service prograni should continue 
with the followinR modifications: 

!• Develop swore progt^s for administrators 

2. Concentrate on those teachers most likely to change 

3, Involve participants in the planning 

4. Plan support and follow-up activities for those presently 
developing projects 

5, Plan more Intensively for a shorter duration 

Efforts should be made to present the program to more parent and business 
groups, and informative brochures should be prepared for diverse publics. 

In curriculum development, project staff should pursue expansion of 
existing programs into clusters. This would Involve Home Economics, 
Environmental Education, and Physical Education departments durir: > the 
next year of operations. Further consideration should be given to^ 
Agri-Business and Healthy probably in cooperative progr^tos with th<i 
State Department of Education, because of community interest. There is 
enthusiasm among the instructional staff to -xploxe cluster development 
in Conmunications and Media, so time and i^esources should be allocated. 
Alternatives for disinterested students should remain a priority. 

Communication with the Northwest Regional Education Laboratory will 
continue relative to their Cofpsnunity Experiences in Career Education 
(CE)^ prograsn. Selection of Great Falls as a field test site would 
.^"h?".?^., ?5?P^^^^ project. As the State Department of 

Education implements legrsTation pertainirig to iearninig disfiJbiritles 
within the context of Special Education, the piraj^^cit will be able to 
address itself to students with special needs. 

Mana^?;eroent efforts must be directed toward finding those succeiJs- 
ful strategies eiaployed by other projects which lead to adoption of 
career education objectives and implementation procedures by instruc- 
Cional staff and administrative authorities. Verbal and/or partial 
financial support do not constitute adequate ccwmnltm^nt to the broad 
goals of Career Education. 
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SUMMARY OF THE REPORT 

<« 

A. Time Period Covered 

July 1, 1974 to June 30, 1975. 

B. Goals and Results 

During the preceding year, the majority of projc ct energies were focused 
upon systcraatic delineation of critical componenTts for a career educa- 
tion curriculum. During this year, comcurrenc a-ctivities were conducted 
to both develop identified components &ncJ conclnue the identification/ 
definition process. These latter activities focused upon the counseling 
function and components for curricular integration. 

A change was also Tnade in the outcome focus for the project. W^ere it 
had been upon four developmental areas — Curriculum, counseling,/ place- 
ment, and management — it now shifted to prescribed student outcome 
.areas. This change was precisely as planned during the first year of 
the project, when it was noted that student outcomes could not be 
achieved in the absence of Operational career education components. 
Categories of outcomes employed during this year were (1) student, 
(2) placement, (3) management, and (A) career education support* 

The typical problems encountered in t-^-eatment delineation within a 
public sclliool setting were manifest throughout the program. Given 
these clas?.^leal shortcomings, several significant findings were 
observed. Achievements of the project in each major outcome area are 
summnrized below: 

Student Outcomes ; Treatments which had a sigriificant effect in each 
outcome area addressed arel- 

A. Self-Awareness (Grades 3, 6, 9) 

B. Awareness and Knowledge of Work (Grades 3, 6, 9, 12) 

C. Career Decision-Making Skill (Grades 9, 19, 11, 12) 

Placement ; Three project supported activities were expanded consi- 
derably. These are the work experience program, cooperative work 
experience program, and the Community Resource Center. The number 
of station^ available and used for cooperative work and work expert^ 
ence was expanded significantly from the prece<ling year. 

A survey was also conducted to determine what success students who 
left school prior to graduation were experiencing in obtaining work. 
This same survey also attempted to determine what school programs 
students perceived as most useful in obtaining "satisfying" work. 
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The inwntdry «ind use of community resources was gre \cly expanded 
throur.li the codrdinatLng activities of the Community Resource Center. 
I'erliaps the most important outcome was the increased use of community 
resources in the lower grade levels. 

This latter condition is a clear manifestation of the interaction 
between program components which had a confounding eff^jct upon 
attempts to measure student outcomes. 

Management t Management of a complex, multi-f acted project is a 
difficult task. It requires a unique combination of close super- 
vision and program flexibility to capture and maximize benefits, 
from unique project effects. 

4 

( 

Major* management concerns during this past year have focused upon 
financial accountability, developmental direction for the project, 
integration of operational components, and facilitation of program 
continuation. 

Kach of these tasks has been addressed and successfully incorporated 
into overall program operations. Especially noteworthy has been the 
continued development of esprit among the staff. 

During this next year, the major management concern addressed will 
be institutionalization of fully developed program components. 

Career Kducaition Support : The project staff participated in a broad 
range of activities, each of which contributed tc? the overall effect 
of the project. Generally, these types of activities do not possess 
a terminal point, i.e.\ they will be continually revised, expanded, 
or adapted to changing conditions within the district. Also included 
are those types of activities designed to provide needed. information 
for continued development. 

Specific activities included: 

A. Installation and testing of Career Information Centers; 

B. Counselor involvement in career-related programs; 

C. Staff development; 

D. Model description; 

n. Assessment of criterion ijiist rurentation ; 
As.--^ssmcnt of treatment instrumentation; 

Study of strategies to facilitate student internalization of 
career concepts; and 

Study of student cari^er patterns. 

332 
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C. Conclusions 



Generally, many significant gains were made in achievement of 
project goals. As expected, some aspects of the project made 
more progress than others. 

Given the data bases which currently exist, it seems reasonably 
safe to predict that goals for the project specified at the outset 
will be fully realized by the end of third year operations. 
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A, DESCRIPTION OF THE PROJECT 
See Fina?, Report^ pp. A-12 



B. PROJECT PROCEDURES 
1. Curriculum Development 

At the elementary level efforts were continued to determine those 
logical places within the existing curriculum for Infusion of 
career education concepts. The emphasis was placed on the basal 
reading adoption and some refinement of unltsf within the social 
science program. Evaluation of supplementary print and non-print 
materials was also continued throughout the year. The new kinder- 
garten curriculum guide, with its emphasis on self-awareness, was 
piloted and subsequently revised for final publication. 

At the secondary level Interested teachers were encouraged and 
assisted by project staff to Incorporate elements of career 
education into their instructional programs. Activities focused 
on self-awareness, decision-making, values clarification, and 
career exploration. Late in the year all secondary teachers were 
surveyed to determine tfte degree to which career education concepts 
are presently emphasized. This will form ihe basis for continued - 
development during 1975-76. A limited number of students partici- 
pated in the Region VIII Satellite Technology Demonstration. 
Although this will not be available in the near future, the evalu- 
ation data should be useful in developing program format, using 
similar media and materials. 

Development of the Community Resource Center proved valuable at 

both-^lementary-and-secondary— levels:5 — Teacher-evaluation-was 

overwhelmingly positive. 

2. Counseling 

New approaches to test interpretation, and the utilization of 
special staff in the Career Information Center, were two efforts • 
to improve career guidance services in the senior high school. A 
change in scheduling procedures also contributed to better use 
of counselor time. 

3. Placement and Work Experience 

Projject staff worked with a Citizen Involvement Committee to plan 
a centralized placement service for young people. The major objec- 
tive is to consolidate the efforts of the various agencies serving 
youth. 
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Cooper^^i^^ ^Ork experience programs have been expanded with the 
addition Agj-i^-business to the vocational curriculum. Plans were 
developed high school administrators for an extended day pro- 

gram wt^^ch ^vild facilitate work experiences outside the cooperative 
prograif^t yould include development of job seeking/job maintain- 
ing ski-^l^' this plan has been submitted to the Superintendent for 
consld^rac>^n by the. Board of Trustees. 

4. Manageiu^nc ^^tivitles 

Routine PiT^J^Qt supervision was extended to include developing and 
conduct^i^g^^^duate inservice classes, editing and publishing cur- 
riculurn^Un>^ developed by participating teachers, organizing a 
cataloging Vetera for professional career education materials, and 
impletn^^^i^^ ^n internal accounting system. 

A great ^e^^ Of time was spent structuring treatment groups to 
ensure. P^oj^^t compliance with established evaluation guidelines. 
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C. EVALUATION OF THE PROJECT 

InttOiductibn 



Rationale; From the outset^ evaluation of the project has been 
' concept ionalized as a long-term effort, with the first and second 
years of project operations being primarily information-based 
studies. During the third year, when the project will be seeking 
to establish generalizability of the developed model, the evalua- 
tion will be predicated largely upon conclusion-oriented studies. 
However, political realities requi/e decision information of various 
types, at different levels, throu^out a project's history. There- 
fore, some evaluation activities reported employed traditional 
design and analysis models, e.g., prepost testing procedures on 
specified dimensions; establishment of base lines for purposes of 
assessing change; etc. This rationale is consistent with the con- 
ceptual structure of the project— Definition, Design, Development, 
and Installation. 

/ 

Evaluation Guidelines : In an effort to systematically derive a ' 
useful definition for career education, the United States Office of 
Education commissioned Development Associates, Inc. tb conduct a 
review of available literature, funded projects, related, legisla-- 
tion and each of the different theories which appeared to contribute 
in some way to the concept of career education. The primary intent 
of this effort was to specify what objectives should Be associated 
with the concept. Development Associates used as their base theo- 
retical constructs which emanated from the work oj/both industrial 
psychologists and edixational theorists. Also , considered were 
several recent attempts to operationally define career education, 
such. as those manifest in experimental programs funded to implement 

career educatio n in pu blic school settings^. \ 

i 

This effort resulted in a list of nine desired student outcomes. 
These are: 

1. Students will demonstrate increased self-awareness; 

2. Students will demonstrate increased competency in basic 
academic and vocational skills; j 

3. .Students will demonstrate increased awareness of work values/ 

and possess a desire to engage in paid or junpaid work; 

4. Stud€fnts will demonstrate increased awareness of and / 
knowledge about work': \ I 

\ I 

5. Students will demonstrate increased competency in career ' 
decision-making skills; 
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6. Students will demonstrate good work habits; 

?• Students will Vlemonstrate work-seeking and work-getting 

skills;. \ • 

8, Students who are^ leaving the formal education system will 
be successful in \being placed in a paid occupation, in 
further education^ or in unpaid work that is consistent 
with their career plans; and 

9. Students will be aware of means available for continued 
education once they have left the formal educational 
system. . ' 

■ 1 ^ ■ 

A second product emergent from Development Associates' work was a 
set; of evaluation guidelines J The model which they "developed was 
presented as a part of the management process for any career educa- 
tion activity. It was conceptualized as beginning with ihe develop-- 
ment of a plan to reach certain goals' or obtain certain /results. 
It' was further predicated upon the belief that evaluative data was 
needed at both the local and national, levels • Primary concern at 
the local level would be to provide those data which woAld facili- 
tate attainment of objectives for a specified project. Data to be 
provided for use at the national level would focus upon those kinds 
of issues necessary in the formulation of policy for continued 
funding and further definition ot the concept of^^career^education. 

The model proposed by Development Associates includes thirteen 
steps which are implemented throughout a continuing evaluation 
process. These steps are: / 

1. Prepare the program overview; 
2* Complete the Outcome J^uestion/Vr^^ 

3. Formulate evaluation questions; 

4. Specify the design; 

to. ' ■ 

5. Specify data sources; 
6'. Select or develop instruments; 

7. Prepare a sampling plan; / 

8. Prepare a data analysis plan; / 

9. Prepare a. data collection plan; 

10. Finalize the design and prepare a'reporting plan; 

11. Implement the data collection plan; 

12. Analyze data; and 
' 13. Report findings. 
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Tliese thi|-teen steps were generally followed in the design and 
conduct of this evaluation to insure that data derived was of 
Tiaximun usefulness at the national level. Steps 1 and 2 are 
equivalent to Phnse I (Pre-Dekign) of this evluation; steps 3 ■ 
tbrougn 10 are equivalent to Phas« II (Design); steps 11 and 12 
are equivalent to Phase III (Design Implementation); and step 13 
is equivalent to Phase IV (Reporting)"*. ; 

Purpose ; In a developmental program, sur^ih vr-. tliQ Great Falls 
Exemplary Program in Career Education, the: ?>rimary purpo^se for 
an evaluation is to supply timely, credible"^, and manageable infor- 
mation that will support both prolect staff and the project sponsor 
in meeting four basic responsibilities. These are: 

1. Establishment of meaningful and valid criteria for project 
outcomes ; 

2. Effective and prudent use of project resources to attain 
project goaljs; 

3. Objective and useful dissemination of information to the 
educational community and other concerned publics; and 

A. Accountability to the sponsoring agency. 

The evaluation plan" implemented^ in addition to satisfying the basic 
responsibilities listed above, was also designed to: 

1. Determine the extent to which the objectives of the 
project were accomplished, 

2. Determine what factory either enabled or precluded the 
accomplishment of specified objectives; and 

''I 

3,^ — Rr-omot-e~the--i4ic^Iusioti--of— access ful--^omponents~of>-t:he — 

project into vocational education programs supported with 
funds other than those from the grant. 

Procedures : Generally, evaluation of the project was accomplished 
in five phases. These are (1) Problem Definition, (2) Design, 
(3) Implementation, (4) Reporting, and (5) Management. 

In an attempt to ensure that information needs of the project 
sponsor were adequately satisfied, evaluation guidelines established 
by the sponsor were systematically followed. As noted earlier, the 
numerous steps outlined in the Guidelines were divided into the 
f Lvcj phases listed above. The complete evaluation design describes 
procedures employed. 
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2. Data Generation 

Tests: In developing the national evaluation guidelines for 
career education programs, Development Associates systematically 
reviewed a number of test instruments for which sufficient research 
data were available and where an attempt had been made to establish 
norms. These tests were organized in relation to student outcomes 
and were recommended -for use by all projects. 

In the majority of cases, recommended tests were employed, as 
criteria for selected treatments. However, in some instances, the 
test also served as a treatment. For example, the Barclay Classroom 
Climate Inventory was employed by teachers as^ a specific treatment 
with the Self-Observation Scales test used as the criterion. 

Recommended tests employed i-n this evaluation are listed iii' Table 1 
A complete description of the- test employment strategy is summarized 
.in Table 2. 

Questionnaires: Eleven questionnaires were employed in the conduct 
, of this evaluation. Objectives addressed are summarized in Table 3. 
Specific project and/or student outcome areas addressed in these 
questionnaires may be determined by examining Table of the Evalua- 
tion Design. On that table, outco.ne areas, project objectives, and 
evaluation objectives are cross-referenced. 

Record Data: In a typical evaluation, a great deal of useful infor- 
mation is routinely generated during project operations. A summary 
of these types of data, called "Record Data", which contributed to 
this evaluation, is shown in Table 4. • 

^^^rii^re_^oiiiplj5^ 

cedTir^¥-iE^loyed for this evaluation may be seen in , the "evaluation" 
design (Appendix A). Much of the information included there has 
been purposely omitted from this. report to simplify the report 
format . . 
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TABLE ..1 
TESTS EMPLOYED 



Test 



Self-Observation Scale 

Career Education Questionnaire 

Career Awareness Inventory 

Career Maturity Inventory 

Career Development Inventory 

Assessment' of Career Development • 

Career Development Inventory 

Career Maturity Inventory 

Career Development Inventory 

Deferential Aptitude Test with Career 
Planning Program 

Barclay- Glassroom~€iimatB— Inventory 

Ohio Vocational Interest Scale 

General Aptitude Test Battery/Interest 
Check List 



Project . 
Objective 



1 
2 
-2 
2 
2 
2 
2 
3 
3 

1 

-1" 



Outcome 
Area 



Grade 
Level. 



I 
IV 
IV 
IV 
IV 
IV 
IV 

V 

V 

I 

-NA- 
NA 

NA 



3-6 

3 
6 

9 
IP 
9 
10 
12 

9 
9 

11-12 
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TAB'E 2 
TEST EMPLOYMENT STRATEGY 



Eval 
Obj 



Population 



Grade 



School 



h 
6 

9 

9 



iPiranklin 
Fi^anklfj^ 

North/Poril 



North/Pariiu 30 



Desi'gn 



30 

30 
30 



pre-post 
pre-post- 

pre-post 

post only 



Dnt-a Requirements 



Treatment 



BGGI 
3GGI 

DAT/GPP 

None 



Griterion 



SOS 
SOS 

abilities 

3elX-report 
abilities 

Sfelf -report 



10 

9 
12 



Whittier 
GcJllins 
Lewis & 
Clark 
Morning8id(^ 

Skyline 
Lincoln 
Meadovlark 

GFHS Gr 10 



;Fast Gr 9 



132 
total 



75 
totail 



ko 



GFHS 



30 
16 



pre-post & 
comparison 



pre-post 

pre-post 

pre-post 

pre-post 4 
comparison 



Teacher Trainirg CEQ 



Field trips, ft 



resource persors 



Use of GIG, 
OVIS % ATS-VI 

ATS-VI 

GIG use/nonuse 



GAI 



3 


10 


,'gfhs 


50 


pro-po3o 






iGFHS 


25 


pre-post 


t 


11-12 


jCMR 


10 


( pre-post 


1 


1? 


!CMR 


30 


pre only 



OVIS 1 TEEB/D&CCMI 



OVIS only 

GATB/ICL/CKEB 

CEEB/D&O 



CMI 

CMI 
lACD 



CMI 
CDI 
ICDI 
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TABLE 2 (continued). 



Eval 
Obj 


Population 


' Design 


Data Requirements \ ! 


Grade 


School 






Criterion 


k 


ll-lU 




15 


post only 


HA 


Quest w/exp 


5 


10-12 


IIA 


6 


post only 


NA 


Quest report 


6 


KA 


NA 


NA 


NA 

v 


NA 


budget 


7 


10-lU 

■ 


NA 


NA 


«A 


Established 
operational 
placement svc 


number students 
placed 

0 
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TABLE 3 

QUESTIONNAIRES EMPLOYED. FOR THE EVALUATION 



j Respondent 


Evaluation 
Objective 


Purpose/Focui'g 


Coop Work 
Coordinators 


5 


Description of procedures em- 
ployed to identify cooperative 
work stations 


Student drop outs 


1 

4 


Congruence between desired and 
actual placement in a Job. Exit 
questionnaires 


Director, Vo-Ed 


5 


Nature and amount of liasion with 
career education for: (a) course 
development, (b) program articxila- 
tion, and (c) program development 


OxU Director 

f 
1 


8 


Inventory of CIC materials. Pro- 
cedures for student use of CIC 


• Gr 11 ft 12 
Students 


8 


Personal perception of value of 
CIC in career decision-making 


Counfjelors 


8 


Frequency of referral or students 
to CIC 


Students who uso 
CIC 


8 


Perceptions of CIC value in career 
de cisi on-making 


Part D Project 
Directors 


13 


Definition and description of 
transportability as employed by 
their projects 


Montana Superin- 
tendents 


13 


Description* of information needed 
to adopt Great Falls components 
developed under the auspices of 
this project 


Teachers vho have 
taken the CE course 


15^ 


Frequency of use of activities 
labeled as career education related 


Teachers vho have 
used nelocted tests 


; 17 


Ratings of selected tests for use 
in CE programs 
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TABLE A 

RKCORD DATA WHICH CONTRIBUTED TO THE EVALUATION 



Objective 


D-i ta 

fluml'or 


Description 


1 


1 


Nua^ber of hours spent in use of (a) ECCI and 
Cb) DUSO I & II 


1 




fJiamber of hours devoted to interpretation of 
OVIS in (a) groups, and (b) individual sessions 


1 


3 


Nuiflber of students in each group nainss in (2) 
above 


1 . 




Number of hours of joint plann'.ng for OVIS 
interpretation by, teachers and counselors 


1 




Description of follow-up act Lvi ties prescribed/ 
from OVIS interpretation by (a) teachers, and/ 
(b) counselors 


1 • 

1 


6 


Hours of classroom usp of DUSO Kits / 

/ ! 


If ^ 


7 


Number of stucfents in classos where DUSo/Kits 
were used / 

'■■/ 


1 


W 


ITBS scores for 30 studonts each, iii grades U, 
8, and 6, whose teachers have completed the 
Career Education course ^ 


1 


n 


ITBS scores for 30 students each, in" grades U, 

and 6, whose teachers have. not completed the 
Caroer Education course 


2 




Number of field trips taken, when, and to where 


r? 


] 1 


Name and occupation of eacfj ronource person used 


?. 


IP 


Number of hours of CIC use for selected sample 
of students who use GFHS CTC uui\ who also use 
counseling services 






wJnss roster and total hourn each student spent 
in use of ATG-6' demonstration I roadcasts 


3 


' \h 


Hours per student spent in use of CEEB materials 
and OVIS interpretation 




IS 


Hours per student spent in use of OVIS scores 
for group counseling 
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3. Report of Data Related to Goal Attainment 

Introduction: As noted earlier, this evaluation has attempted to 
satisfy a diverse range of information needs and requirements; 
from those Required by the Evaluation Guidelines to those of the 
project for short and long range planning. 

The most expedient reporting format appeared to be selected outcome 
areas described in the Evaluation Guidelines. However, a number 
of evaluation objectives were not directly related to these and 
. have been reported as "Related Activities". 

* 

Self-Awareness; The evaluation design prescribed measurement of 
changes in student self-awareness in grades three, six, and nine. 
At each grade level, a prepost design was employed, using a cri- 
terion judged appropriate for the treatments employed.' 

The treatment for grade three was use of the Barclay Classroom 
Climate Inventory and subsequent interpretation/use of that instru- 
ment by the classroom teacher. Th^ criterion employed was student 
performance on the Self-Observation Scales. 

Teachers spent an average of 11.75 \?ours using the B.C. C.I. Unfor- 
tunately, due to administrative problems, it was not possible to 
use the S.O.S. as a prepost measure. Since only one measure is 
available, it will be established as a baseline for subsequent years 
of the projeqt. , 

Student performance on both the primary and intermediate forms of 
the S.O.S. is reported in Tables 6 through 8, respectiyeix.^' 

At grade nine the treatment employed was use and interpretation 
of the Differential Aptitude Test/Career Planning Program. The 
criterion was a student self-report of abilities. In addition to 
the treaLr:ient group, a second group of students was selected as 
a comparison. No attempt was made to match these groups due, pri- 
narily, to administrative problems inherent in such procedures. 

Change.?? in student self-report of abilities for the treatment 
group are shown in Table 9. As shown, there were significant 
changes in student awareness of their Verbal Reasoning Abilities, 
Numerical Abilities, Arithmetic Reasoning, and Spatial Relations. 
Tlie comparison group received no treatment. 

A- shown in Table 10^ the treatment group demonstrated a significant 
i!iCiease in perception of ability while the comparison group did not. 
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•IVo additional tests were made to assess the adequacy of the cri- 
terion. As shown in Table 10, there is a significant correlation 
between treatment group pretest scores and actual performance on 
the D.A.T. Additionally, variance was homogenous within the- treat- 
ment group. 

These data, while promising,, also suggest that some other factor 
was operating within the treatment group; for the comparison group 
could have been expected to perforin equally. 

Data presented in' Table 10 also show a significant difference on 
the pcst-test bettreen the treatment and comparison groups. Given 
the other differences which existed, this was expected. 

These data strongly suggest that use of the DAT/CPP was influential 
m changing students self-awareness on the constructs me^ured by 
the p.A.T. However, due to the lack of control manifest in typical 
- classroom studies, it is impossible to establica a causal relation- 
ship. • 

f 

Further study of Che DAT/CPP as a strategy to change student levels 
of self-awareness; is warranted -by the data. 

A wareness of. and knowledge, about. Work ; Measures of this outcome 
area were taken in grades three, six, nine,-^aiuL_twelve. In each 
case a different treatment was employed and, consequently, i-ross 
grade level comparisons ^hould not be made. 

The treatment at grade -three^wad Curriculum Infusion, which was ' 
defined in this project as a teacher who had been trained in Career 
EducatiorT. ■ Comparison groups were again employed, using teachers 
v.ho had nor been formally trained rn Career Education. The criter- 
i-.n for both groups was th Career Educatior Questionnaire. 

As showi ih Table 11, a- significant difference existed between pr^V- 
ard post-r.est scores for the f:re,.atment: group . Daira presented also 
shows a si,-r.xf icant difference between the treatment and comparison 
groups on the post- test. 

Thfse data support ihf; conclusion that teacher training has a sig- 
nificant influence development of student a^^areness of, and know- 
ledge about, work a - grade level • thr;.e. 

The treatment at grade six consisted .cf an ad-hoc use of 'field trips 
nnd resource persons. Representative field trins included (1) Air 
force Base, (2) printing plant, (3) banks, (A) geological sites, 
(j) auto repair shop, (6) state and federal govern,i:ent office, 
I. -) city oif ices, anc' (3) retail sales stores. Total number of 
field trips taken Lv the three treatment groups was 38. 
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A variety of resource persons were used by treatment group teachers. 
Tiicy included numerous professions, trades, and government employees 
A total of 26 resource persons visited and/or met with treatment 
^roup classes throughout the year. 

Tlie criterion employed at grade six was the Career Awareness Inven- 
tory. It was administered in a pre-post-test design. Data derived 
from this . testing procedure are shown: in Table 12. The difference 
between. pre- and post-testing across the groups was significant. 

This analysis was across treatment .groups rather than pre-posr for 
each group. Consequently, sin-ce a directional change was not 
hypothesized, a two-tailed test was felt to be more appropriate. 

, .. ■ . ✓ • 

Uhile the pre-post test results are significant, some caution 
should be exercised in drawing conclusions about a causal rela- 
tionship between treatment and criterion. Additional studies are 
: warranted to determine what variable,' or combination of variables, 
would account for the difference obtained. 

Several treatments and two criterion tests were used at grade nine. 
.Treatment administered and the criterion employed for each are out- 
lined below: 

- Curriculum Infusion/C.M.I. ' ' 

- ATS-VI Demonstration/C.M.I.' 

- ATS-VI Demonstration and Counselor Interpretation/C.M. t. 

- In terp re ration of O.V.I.S. results /CM. I. 

- Interpretation, by teacher and counselor, of both O.V.I.S. 
and C.E.E.B. Program/C.M.I. 

r - Use of . Career Infprmatlon Center/A. CD. 

Curriculum Infusion was. again defined as teachers who had completed 
iormal training in career education. As shown in Table 13, this 
treatment had no significant effect upon students in grade nine. 

Result?; of the ATS-VI Dei^onstration. are shown in Table 14. This 
treatment did have a is£gnificant effect upon ninth grade students. 
Complete pre-post- test datra were not available for grade ten due 
to administrative probIt<?^.'s. 

Tli£ ATS-VI Demonstration, coupled with counselor interpretation 
did have a significant effect upon grade ten students. These data 
are reported in 'Table 15. 
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Data presented in Table 16 suggest that use of 0. V. i;S. ' test 
:results only does not have a significant effect upon student 
performance. Tliis is further reinforced by the low correlation 
between the self-appraisal scale on the Career Maturity Inven- . 
tory and hours of counseling each student received. 

Data presented in Table. 17 describe the efFects of teacher andV 
counselor interpretation of the O.V.I.S. coupled with the C.E.E.B. 
Decisions and Outcomes Program. As shown, this intense effort, had 
little effect upon student performance- The negative correlation 
between this strategy and student scores on the self-appraisal ' 
scale of the C*.M. I. suggest the strategy may have been too 
intense - students learned too much about themselves and were 
possibly unable to cope with what was revealed. 

Each of the treatment groups described on the previous page were 
-compared with p. general sample of students, agai;n using the C.M.I. 
The results of- this comparison are shovm in- Table 18. These data 
suggest three' conclusions: (1) The C.M.I, is 'not sufficiently 
sensitive to detect changes in student awareness and knowledge 
about work, (2) Students at this grade level are unresponsive to 
treatments of- the type employed, and (3) Studies to identify a 
better criterion are- warranted. 

At grade 'twe'^lve, the treatment employed was the use, by students, 
of a sta!ffed Career Information Center, , The criterion employed 
was the A. CD. test. Results of this study are presented in 
Table 19^. As shown, there is no significant difference between 
the pre-post-test< However, this treatment is very loosely 
defined and it is difficult' to draw any conclusions from these 
data. 

A soperate study of student use of the C.I.C. is reported in a 
laior section of this reporc. This information was sought in an 
attempt to.dufine more precisely what contributions a C.I.C. might 
make to a career education program. 

The lack of significance in each of these treatments was, to say 
the least, perplexing.i ■ Consequently, maturity was established 
as the independent variable for a separate study with the A. CD. 
as the criterion. Data from this study are presented in Table 20. 
As shown, students in grade eleven performed significantly better 
on this test. These data suggest that some combination of 
variables was, in fact, providing students with the desired know- 
ledge. Further study of these factors should be completed. 
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Basic Skills; Only one study, at grades four and six, was conducted 
for this outcome area. Results of the study ^are reported in .Table^ 
21. The logic of expecting a chaiige in student basic skills as a 
result of participating in career education activities is /very ^ 
we.ak. The lack of significant differences was expected. - / 

The problem here appears to be not with the treatment or the'"^ 
criterion, but with the outcome area itself. It appears tHe major 
concern is one af student motivation, not basic skills. /One 
could expect student perform.ance o'n a test of basic skil<ls to 
change if, over an extended period, he had been highly motivated 
to learn these skills. 

It is suggested the project sponsors reconsider the logic of this ' 
oiitcome area. 

■ Career Decision-Making Competency : Assessment in this area </'as ^' 
limited to grades ten, eleven, and twelve. However, a variety of 
nreatmehts were employed, including use of the C.E.E.B. /Decisions 
and Outcomes Program, interpretation for students of their per- 
formance on the General Aptitude Test Battery, and the Interest 
Check Lisu. 

Data from the C. E. EiB . /Decisions nnd Outcomes treatment are 
reported in Table, 22. As shown, there were no significant dif- 
ferences within the various treatment groups oh any of the major 
scales. This same condition (n.s.d.) obtained when treatment 
groups were compared to a non-treatment group. These data are 
presented in, Table 23. 

Tho lack of definite findings and several other factors suggested 
additional analysis and continued studies were appropriate. Con- ^ 
sequently, basel ines have been established for subsequent years. 
These are shown in Table 24. Shown in Table 25 are correlations • * 
obtained between student scores on the C'.D.I. and G.P.A. As 
shown, only one proved to be significant, which suggests th§ 

^C.D.I. is a poor predictor of G.P.A. Tlie question not answered 
is what relationship exists between G.P.Ao and Career Decision- 

:Making\skills. The answer to this, obviously, must come from a 
long-term study of some type. -^^ ■ ^ 

Related -Activities ; Data are reported in this sect: on which 
describe a -broad range of project activities,* each of which is 
related to development of an exemplary mod.el for career education. 
The order of presentation is congruent with the order of evaluation 
objectives (see Design, Appendix A). 

Establish the degree of congruence between actual and 
dt\sired student work placement : One of the continuing 
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project concerns has been its effect upon students who 
leave school, and especially upon student satisfaction in 
work obtained. This, concern is the essence of^the require 
mont outlined in evaluation objective four. 

The broad ran^»e of possible contribaxing factors neces- 
sitated narrowing the scope of this objective, finally to 
addressing only those stude^nts who left school prior to - 
completion of a formal pro^raiii. ^ 

A questionnaire was designed for administration to these 
students. The focus of this instrument was: 

a. Reason for leaving school; 

b. Job or position sought; .. ' " 

c. Current activities relative to their changing jobs; 

d. How their present position was obtained; 



e 



Respondents' perceptions of necessary . qualifications 
'for their present, position; 



f. The most "satisfying*' aspect of th-ir present position; 

and "^-^ 

i N., 

g. The least "enjoyable" aspect^^of their present positon. 

j 

The problems in using thisj student population are obvious - 
they are scattered across 'the country and are, very diffi- 
cult to locate. However, [ten students .who had left school 
were located and completed the questionnaire. 

Describe expansion of job preparation opportunities 
including vocati onal education and cooperative work exper- 
iences in grades elev en through . fourteen : There appears to 
nave been a significant increase "in the number of training 
stations employee} during this year compared to last year.' 
In 19 73-74, coordinators reported an average inventory of'-^- 
37 training sites. An. average of 106.5 sites was reported 
during 1974-75. However, there may 'have been some misunder- 
standing among the coordinators as< to what constituted a 
training site, as reflected in the range of numbers of 
sites. This -statistic was 327. The median number of sites 
reported in 197^-75 was ,57.5. 

Several other comparisons with 1973-74 show some impor- 
t<'mt trends. These include: 

■a. Nearly half (45Z) of tlie coordinators report super- 
vising 41 or more students. During 1973-74, the mean 
number of students supervised was 24; v 
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b. Only one coordinator reported a formal student 
training program in 1973-74* Seven coordinators 
(78Z| reported such programs in 1974-75; 

^''^ • ■ . 

c. Several important changes in criteria used to select 
students for the cooperative work program are shown 

^ in -Fijgure 3. For example, completion of prerequisite 
courses, economic need, and teacher recommendation 
are riot used as frequently;^ Generally, these could 
be considered an improved condition; and 

d. Coordinators have assumed much more responsibility 
for final selection of students (60% . to/ 89%) . , 

• / i 

Coordinators were asked t.o list what they j^erceived as the 
most significant constraints to operation of the coopera- 
tive work program* Their responses were: / ' . 

a. Teaching load; 

b. Business economics of the comihunity ; 

c. insufficient personal contacts (rela/tes to (a.) above) 
d* Poor career counseling for students/; 

e. Student classroom load;' ^ 

f. Lack of equipment; 

g. Lack of time to devote to coordination ;• and 

h. iCmployer education. ■ ! 

An Important factor relative to expansion of the cooperative 
work and vocational education programs is the number of 
teachers who completed . the Career Education Training Pro- 
grc-nn conducted by the project. During 1974-75, fourteen 
completed the program, with three of/ these from outside 
the Great Falls School District. / 

Developm ent and use of Career Information Center ; Several 
alternative formats have^been 'employed in establishing 
C^I-.C.|s, with the major difference being in staffing. The 
following information about the center was provided by the 
Project Director: 

a. All librarians were directed ;to .recategorize material 
and centrally locate career cdQcation materials. 
Purchase of new material was' to be emphasized on all 
orders. There was more emphasis in the elementary 
libraries which, heretofore, had not purchased much 
of this type of material, .l^^}nle seK-awareness is 
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st!t:i as an element of- career education, it is most 
o[toi\ 'Tiled" as ^;uidance material. 

b. Two sources were used for bagic book and audio- 
visual select-ion - Book List and Media and Methods , 
Selection of materials is generally ^ based upon 
recommc'.nd^tions of teachers and/or project staffs 

It is standarld procedure to o'rder material on approval 
for review. 

/ 

c. Funding sources for materiaTs-come from four major 
areas: 

1. Regional Library Budget; 

2. Instructional Materials Center Budget; 

3. Disttict Instructional Materials Order Form; 

4. Project Funds. 

d. Regular library procedures are used for student use 
of C.I.C. All material is accessible, but not all 
types can be taken home 4)ecause r-f insufficient \ 
equipment for. checkout. 

e. There exists some rivalry between librarians and 
counseling staff as to where materials should be^ 
housed. This has improved somewhat during the two 
years of the project.. :.The supervisor fed* the 
graduate classes have helped articulation; ^^.y?ng all 
levels. She particularly mentioned the iih-rary 
staff and English teachers working together on a 
skills unit based on the theme of career education. 

Student perceptions iof Ihe us.;:?f ulnoss of tiie Career 
Infonr-ition Centers ,at Hreat Fails High School and 
Cliarles M. RusselT Hij;h ^::,lioo!I are described in Tables 
28 and 29, respect Lvely, The. most important information 
is that students found the Centers* useful in making career 
decision, which is whut they are designed to accomplish. 

Cstabl ishmeint and use of a Community Resource Center ; 
Systematic development of a.. Commuriity Resource Center 
was initiated in 1973-7A. Procedures employed are : 
reported In the 1973-7A annual report. This center has 
proven very effective and useful, as shown by data"^ ' 
presented in Table. 30 and by the increased number of work 
stations reported by ^coordinators . 
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^- '^^^finitio n of Model Transportability ; A number of persons, 
including other Exemplary Project directors and federal 
government representatives, were contacted in an attempt 
to establish a concensual definition for transportability. 
Unfortunat^ely , response from persons contacted was .very' 
poor. Ccneraliy, transportability was defined as the 
• ability t;o use. materials and strategies developed in 
similar situations. Types of materials included were 
Teacher Resource Units, Learning packages , etc. 

Many of the responses described a rather naive point of 
viov re^^arding the prohierns historically associated with 
generalization of materials and strategies. This concept, 
, and its use in career education, should be examined care-' 
fully. * . : • 

^- A>^.se5S t hL- effects of Staff Development Activities ;" As 
.in most studies conducted in a public school environment, 
the necessary rigor to establish causal relationships is' 
* ' o ' ' " acli ieve. En this case a decision was 

J made to design the study around figuring of teacher use 
\ of strategies addressed in the project sponsored training 
program. 

Conclusions and Recommendations 

introduction: The need for a 'document such the evaluation guide 
Jines was^- clear. However, the guidelines produced were sorely :' 
inadequat- as guidelines for evaluation in public school settings^' 
Perhaps the most difficult problem was in attempting to achieve a 
'^ne degree of precision necessary in treatments to satisfy the in- 
tent of tiie guidelines. Unfortunately, the guideline document only 
recognized this problem - it offered no useful strategies for i 
overcoming the problem. 

The credentials of the guideline authors are impeccable-. However, 
thc> guidelines themselves reflect some naivete' about conditions ' 
in public school settings, dlad they been restricted to a direct 
extension of Stenner's notions about i nf ormat ion~based evaluation 
they migii^ fiave proven 'more useful. 

Conclusions; Data presented in preceding, sections supported the 

followiut:. conclusions: , \ 

1 - Sol f-awnreness ; . ^ 

a. I'rado tiiro.j and six: Comparison tests were not made. 

iiowt-zer, there is some evidence Lhat^^use of the B. C.C.I, 
does have an effect upon student sei f -awaf eness. 



353 



b. Grade nine: Significant changes were observed on some 
scales of the D.A.T. when the D. A.T. /C.P.P. was used 
^.s the treatment. The criterion proved to be 
sufficiently valid. Additional study of this use 
of the D.A.T./C.P.P. is warranted. 

Awareness of, and knowledge about, work : 

a. .Grade three:. Teacher training has a significant 
influence. ' 

b. Grade six: Intensive use of field trips and 
resource persons has a significant effect. 

c. Grade nine: Teacher training had no effect. The 
ATS-VI Demonstration, both singly and in .combination 
with counselor interpretation, had a significant 
effect. Teacher and counselor use of the O.V.I.S. 
had' no significant effect. Use of O.V.I.S. scores 
and the C.E-.tE.B. /Decisions and Outcomes program, in 
combination, had no significant effect. 

d. Grade twelve: Student use of a Career Information 
Center did not affect their performance on the A. CD. 
However, there is a great deal of evidence to suggest 
that a C.I.C. is a power;Pul treatment. More careful 
study of its effects is required. ' 

Basic Skills : As expected, no significant changes were 
observed. The logic which related changes in basic 
skills to a very short terra treatment is open to serious 
question. 

Career Decision Competency :. No significant differences were 
found on the criteria employed. However this was not 
unexpected, as. the construct is extremely complex. 

Placement ; The study included in this evaluation was dif- 
ficult in that subjects were extremely difficult to locate. 
Additionally, it is likely that subjects used were the 
most difficult to assist, due to their expressed lack of 
career goals. and interest in self- improvement. Among . these 
subjects, there was little satisfaction with^^ their present 
jobs or congruence with desired jobs, however, the 
subjects were not clear on what jobs they desired, which 
would' make any placement service ineffective. 



Expansio n of lob preparation opportunities ; There has been 
a significant increase in this area. 

Budget manaRement : Excellent records were maintained. 
Judgements about the distribution of funds are left to the 
project* sponsor. 

^* Career Information Centers ; These have proven to be one ,of 
the more important project outcomes, 

^* Gonignunlty resoutces ; This resource has been carefully 
developed by the project and is receiving wide usage by 
teachers • 

^^V Staff development ; The training program sponsored f?^cl 

conducted by the project has had a sitjnff leant effc;^ upon: 

a. Student outcomes; 

b. Use of community and other resources; and 

c. Use of career-related instructional stratecies* 

r 

cVnorally. the project has effected a number of important changes - 
, in Che education pfogrsuns of th^* Gr.at Falls Public Schools. The 
staff represent a major force in effecting change within the dis- 
trict, wTiich has resulted' in several usjeful and important prcgrar* 
changes/ Tliese changes are evident in student outcomes. f 

(V.r factor which serves to have a distressing lack of influence 
is /ounselor intervention. A careful study of the entire district 
o/;iseline; program would be useful in on attempt to identify what 
^nstraints are interfering with counselor effectiveness. 

/ Rocommen dations ; The . following recommendations are based upon 

data presented in this report and upon general observations of the 
project. 

\ 1. A careful study of tests to be used as crlttiria for 

V * project outcomes should be completed. Project staff 

currently have sufficient experience with a variety of 
tests to select those which should be studied. 

^. Selected project components should be described with 
sufficient precision and detail such that they may bu^ 
readily transported to other setting^;. 
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Alternative funding, including local district funds, should 
he sought. ^ 
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T!ie role and use of counselors should be studied in 
an effort to increase the degree of effect they have 
upon the career aspects of student education. 

Some thought should be given to designating an indi- 
vidual who has both the time and responsibility to 
coordinate vocational education offerings at the 
secondary level. Thif?^ responsibility should include 
ijrt iculation of vocational education prcigrams. 



D. PROJECT OUTCOMES 



I. fntrnduction 

A ratiu-r detailed discussion of the developmental procedures to be 
employed by tlie project was presented in the first annual report. 
Tlio model proposed there included three "Levels of Development." 
W^'\]c these levels were not expected to be congruent with years 
of project operation, there is naturally some correspondence, along 
with some overlapping, between the two. 

The general rationale was, in a linear and systematic fashion, to 
define components for a "transportable" model, design the specific 
aspects of each component, and then focus upon implementation of 
those components within the district. In many cases, it ii=} 
impossible to maintain the linearity of this model. Consequently, 
design, development, and installation wer.- found to interact in 
nany cases. However, the criterion was. successful implementation 
of the component. 

Program outcomes^ in relation to these considerations » are 
discussed below. • 

2. Component Development 

Community Resource Center ; This activity is perceived as one of 
the strongest and most beneficial activities of the program. 
Through this activity, teachers have been able to systematically, 
and rather vigorously, employ a resource that would not have been 
available without the project's support. The center has enabled 
teacher*} to heighten student awareness of career opportunities 
while simultaneously obtaining support for the career education 
program from the community. In this respect, the project has 
attempted to follow reconanendatlons made in the first year evalu- 
ation report, i.e., have a sound program design before soliciting 
heavy support from the community. 

Career Information Center : Tliese centers have progressed from an 
idea to operating centers in a very short petiod of time. At 
least one of these centers (Great Falls Hlf.h School) is staffed on 
a Tull-timc basis. The centers are currently bperatiopal. 
^iovvcver, some work remains in training students, counselors, and 
; ,M<'iiers in how best to iLse these centers. 

Curriculum Program s Initial steps were taken to implement the 
career education scope and Fiequcnce prepared during the first year 
of the project. This Included continuing work in developing 
inrtruct^onal units, coordination of work experience and* in-school 
activities, and greater in- ;^jLvemcnt of counselors in all areas 
and at several levels. 
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Si^veral important additions in the secondary curriculum were 
nade* These included courses in (1) Sales and Sale Promotion 
and Management in the Distributive Education Program, and 
(2) a vocational education program in Agri-business. PUns are 
being made to investigate and possibly develop programr^ In " 
Health Occupations and Home Economics, lliis latter program 
will focus upon wage-earning aspects of home economics as 
coniparcd to traditional prof^rams. 

Maif Development ; Tiiis project activity has proven to.have 
si>:nificant benefit relative to expanding the concept of career 
education within the district. As staff become more fully aware 
i>r what can be done in career education, they begin to exercise . 
non* fully the services provided through the program. Evaluative 
data presented earlier in tliis report clearly show the relation- 
stup whicii exists between completion of a course in career 
education and frequency of use for career-related instructional 
^tratO'Al(.^s. In all likelihood, staff development activities 
of the project will have the greatest influence on achieving a 
multiplier for integration of career education concepts. 

Counseling ; Some progress has been made in effecting broader 
input from counselors into the career education program. However, 
there still exists a number of Gonstraintj within the district 
which nust be addressed before the desired levels of counselor 
input will obtain. 

Hiero has been a significant increase in the extent to which 
counselor.^ and teachers interact, jointly, with students. This 
strategy will most likely resolve many of the difficulties con- 
frontiHl. 

r iaconent and Work Experience : The project staff is working with 
Hf Citi;:on Involvement Committee to develop a centralized placement 
st^rvicf for young people. Since there are a number of agencies 
M'rvini;: voutli in Great Falls, tlie major objective is to consolidate 
piaconont efforts. 

u\>opi»raLive work experience programs have been expanded, and plans 
have been developed for an extend€?d day program which would permit 
work experience outside the cooperative ^programs. A job clinic 
va< held at Great Falls High School for interested students to 
tmi^iiasl/te job seeking/job maintaining skills. Loc<il business 
pt^oplo assisted project staff. 

Con^po'/H^nt Integration 

in all projects of this type, the level of districl: cornBit.tment 
necessary to achit^ve wide spread integration of career i?dlacatiion has 

n dltflcult. CO achieve. Career education taust Ije considered in 
f'* Lit ion to all other district programs. \ 

i 
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However, the following components appear to be fully integrated 
into on-going programs of the district: 

Commuhity Resource Centers 

Caroor Information Center 

Teacher Developed Instructional Units 

Career-RtTlated Media Support 

Cooperative work Program. 

Work Experience Program 

Staff Development 

Modol Definition 

During the first year a number of strategies wer^ employed to 
id?ntify the desired form of major student outcomes. During this 
past year, specific treatments were established and tested in an 
effort to identify those which would be most effective in 
achievinr, the desired type and amount of effect in each of the 
najor outcome areas. It is expected that data derived from this 
year of project operation will serve to structure future project 
operations which will lead to full implementation of those 
strategies which have proven most effective. 

Outcome areas addressed include: (1) Self-Awarenesfi^^ (12) Work 
Values, (3) Work Awareness, (4) Obtaining Work, (5> Career 
Decision-Makinj;^ Competence, and (6) Placement. 
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RECOMMEND. VI IONS FOR FU7URL ACTION 



i; cnnponets of the proJt:iCt are to be fully Institutionalized 
prior t.y^ termination of the project effort, they r.iu:,^ be fully 
lr^Le>!:ruti'd at tht timt^ of project termlnatinr. Tliurefore , maior 
:)roJi»cr: omphanis wK.l be upan integratioa of those components 
whirl: luivi" proven to bt most effective in effecting curricular 
;'!K-ni'.:t>, curri-ular articMlatlon, and in chc'.nging student 
: oi avior towarcl do.sired goals. 

Additionally, the project has a responsibility to fully judge, 
and fully describe the operational context for those components 
which arc to be included among transportable components, 
RvT.aininf. energies will be directed tcv/ard continued defini- 
tion and development of program components. 

Components for which integration will be sought include (1) Career 
Information Centers, (2) Community Resource Center, (3) the various 
placement activities, (A) staff development, and (5) district 
Tiedia support. 

Those components will generally comprise those activities which 
will ultimately become included in a tran^-portable model. There- 
fore, description and judgement of these components will also be 
effected. 

Continued developmental activities will focus upon: 
I. Treatment delineation; 

-I. Articulation of vocational education and work programs; 

3. Identification of alternative roles for counselors; 

Identification of constraints to adoption of each counselor 
role identified; 

?. Design o/ strategies to inplenent selected roles for 
counselors; 

Development of a multiplier model to broaden the effect of 
staff development activities; 

7, (Operational definition of "life roles" using data bases 
established during years one *ind two of the project; and 

8. D^>velopnent of a 'public information program which will 
resr;It in heightened awareness of the program a^nong poten- 
c ial clientele*. 
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